2019-11-25T08:57:29.658 INFO:root:teuthology version: 1.0.0-c5aab4e 2019-11-25T08:57:29.659 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.9fj1dZ.tmp -- --verbose --lock --description rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} --name yuvalif-2019-11-25_06:14:24-rgw:verify-wip-yuval-add-kafka-security2-distro-basic-smithi --block --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2019-11-25_06:14:24-rgw:verify-wip-yuval-add-kafka-security2-distro-basic-smithi/4542043 2019-11-25T08:57:29.700 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-25T08:57:29.760 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuvalif-2019-11-25_06:14:24-rgw:verify-wip-yuval-add-kafka-security2-distro-basic-smithi/4542043 branch: wip-yuval-add-kafka-security2 description: rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} email: yuvalif@yahoo.com first_in_suite: false job_id: '4542043' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuvalif-2019-11-25_06:14:24-rgw:verify-wip-yuval-add-kafka-security2-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos overrides: admin_socket: branch: wip-yuval-add-kafka-security2 ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd objectstore: filestore osd shutdown pgref assert: true osd sloppy crc: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 12b9659be24ae0e3d791f80d81504ab2770c1343 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: notcmalloc sha1: 12b9659be24ae0e3d791f80d81504ab2770c1343 rgw: compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: civetweb storage classes: LUKEWARM, FROZEN s3tests: slow_backend: true workunit: branch: wip-yuval-add-kafka-security2 sha1: 12b9659be24ae0e3d791f80d81504ab2770c1343 owner: scheduled_yuvalif@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 12b9659be24ae0e3d791f80d81504ab2770c1343 suite: rgw:verify suite_branch: wip-yuval-add-kafka-security2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-add-kafka-security2/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 12b9659be24ae0e3d791f80d81504ab2770c1343 tasks: - install: flavor: notcmalloc - ceph: null - openssl_keys: null - rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 - swift: client.0: rgw_server: client.0 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.9243 2019-11-25T08:57:29.760 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-add-kafka-security2/qa; will attempt to use it 2019-11-25T08:57:29.761 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-add-kafka-security2/qa/tasks 2019-11-25T08:57:29.761 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-11-25T08:57:29.763 INFO:teuthology.task.internal:Checking packages... 2019-11-25T08:57:29.781 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash '12b9659be24ae0e3d791f80d81504ab2770c1343' 2019-11-25T08:57:29.781 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-11-25T08:57:29.781 INFO:teuthology.packaging:ref: None 2019-11-25T08:57:29.781 INFO:teuthology.packaging:tag: None 2019-11-25T08:57:29.782 INFO:teuthology.packaging:branch: wip-yuval-add-kafka-security2 2019-11-25T08:57:29.782 INFO:teuthology.packaging:sha1: 12b9659be24ae0e3d791f80d81504ab2770c1343 2019-11-25T08:57:29.782 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&ref=wip-yuval-add-kafka-security2 2019-11-25T08:57:29.970 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7614.g12b9659 2019-11-25T08:57:29.971 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-11-25T08:57:29.981 INFO:teuthology.task.internal:no buildpackages task found 2019-11-25T08:57:29.981 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-11-25T08:57:29.994 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-11-25T08:57:29.994 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-25T08:57:30.056 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:57:40.074 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:57:50.084 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:58:00.100 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:58:10.116 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:58:20.134 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:58:30.149 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:58:40.165 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:58:50.181 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:59:00.201 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:59:10.221 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:59:20.236 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:59:30.254 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:59:40.271 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T08:59:50.288 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T09:00:00.304 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T09:00:10.328 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T09:00:20.345 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T09:00:30.363 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T09:00:40.380 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T09:00:50.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T09:01:00.421 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:01:10.438 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:01:20.485 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:01:30.501 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:01:40.515 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:01:50.532 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:02:00.550 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:02:10.566 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:02:20.580 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:02:30.598 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:02:40.616 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:02:50.645 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:03:00.660 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:03:10.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:03:20.722 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:03:30.740 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:03:40.756 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:03:50.773 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:04:00.790 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:04:10.808 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:04:20.825 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:04:30.842 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T09:04:40.860 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-11-25T09:04:50.877 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:05:00.892 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:05:10.911 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:05:20.924 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:05:30.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:05:40.969 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:05:50.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:06:01.007 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:06:11.025 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:06:21.040 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:06:31.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:06:41.077 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:06:51.089 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:07:01.106 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:07:11.121 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:07:21.137 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:07:31.155 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:07:41.170 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:07:51.184 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:08:01.200 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:08:11.219 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:08:21.237 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:08:31.254 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-11-25T09:08:41.272 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_yuvalif@teuthology', 'description': '/home/teuthworker/archive/yuvalif-2019-11-25_06:14:24-rgw:verify-wip-yuval-add-kafka-security2-distro-basic-smithi/4542043', 'machine_type': 'smithi'} 2019-11-25T09:08:41.295 DEBUG:teuthology.lock.ops:locked ubuntu@smithi135.front.sepia.ceph.com, ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:08:41.449 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-25T09:08:41.660 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 7.6 2019-11-25T09:08:41.666 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 7.6 2019-11-25T09:08:41.985 INFO:teuthology.orchestra.console:Power off smithi135 2019-11-25T09:08:41.986 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-25T09:08:42.042 INFO:teuthology.orchestra.console:Power off smithi174 2019-11-25T09:08:42.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-11-25T09:08:42.084 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:42.113 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:46.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:46.178 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:50.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:50.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:50.509 INFO:teuthology.orchestra.console:Power off for smithi135 completed 2019-11-25T09:08:50.610 INFO:teuthology.orchestra.console:Power on smithi135 2019-11-25T09:08:50.610 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-25T09:08:50.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:54.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:54.676 INFO:teuthology.orchestra.console:Power off for smithi174 completed 2019-11-25T09:08:54.689 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:54.778 INFO:teuthology.orchestra.console:Power on smithi174 2019-11-25T09:08:54.779 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-11-25T09:08:54.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:54.946 INFO:teuthology.orchestra.console:Power on for smithi135 completed 2019-11-25T09:08:55.048 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2019-11-25T09:08:58.860 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-11-25T09:08:59.089 INFO:teuthology.orchestra.console:Power on for smithi174 completed 2019-11-25T09:08:59.190 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2019-11-25T09:11:26.020 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:11:30.044 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:11:35.083 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:11:39.114 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:11:44.141 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:11:48.170 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:11:53.193 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:11:57.230 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:12:02.250 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:12:06.282 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:12:11.306 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:12:15.337 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:12:20.362 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:12:24.394 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:12:29.422 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:13:06.862 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:13:07.168 INFO:teuthology.orchestra.run.smithi135:> hostname 2019-11-25T09:13:07.642 INFO:teuthology.orchestra.run.smithi135.stdout:smithi068 2019-11-25T09:13:07.643 INFO:teuthology.orchestra.run.smithi135:> grep smithi068 /etc/hosts 2019-11-25T09:13:07.694 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2019-11-25T09:13:07.695 INFO:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2019-11-25T09:13:07.883 INFO:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi068/smithi135/g' /etc/hosts 2019-11-25T09:13:07.943 INFO:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.68/172.21.15.135/g' /etc/hosts 2019-11-25T09:13:08.031 INFO:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi068/smithi135/g' /etc/hostname 2019-11-25T09:13:08.090 INFO:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2019-11-25T09:13:08.151 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2019-11-25T09:13:08.152 DEBUG:teuthology.parallel:result is None 2019-11-25T09:13:30.412 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:13:30.651 INFO:teuthology.orchestra.run.smithi174:> hostname 2019-11-25T09:13:31.210 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174 2019-11-25T09:13:31.210 INFO:teuthology.orchestra.run.smithi174:> grep smithi174 /etc/hosts 2019-11-25T09:13:31.296 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2019-11-25T09:13:31.296 INFO:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2019-11-25T09:13:31.461 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174/smithi174/g' /etc/hosts 2019-11-25T09:13:31.581 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2019-11-25T09:13:31.679 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174/smithi174/g' /etc/hostname 2019-11-25T09:13:31.757 INFO:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2019-11-25T09:13:31.833 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2019-11-25T09:13:31.835 DEBUG:teuthology.parallel:result is None 2019-11-25T09:13:32.086 INFO:teuthology.lock.keys:Checking smithi135.front.sepia.ceph.com 2019-11-25T09:13:32.087 INFO:teuthology.lock.keys:New key found. Updating... 2019-11-25T09:13:32.121 INFO:teuthology.lock.keys:Checking smithi174.front.sepia.ceph.com 2019-11-25T09:13:32.121 INFO:teuthology.lock.keys:New key found. Updating... 2019-11-25T09:13:32.143 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2019-11-25T09:13:32.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:13:32.144 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:13:32.254 INFO:teuthology.orchestra.run.smithi135:> true 2019-11-25T09:13:32.667 INFO:teuthology.orchestra.run.smithi135:> uname -m 2019-11-25T09:13:32.746 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2019-11-25T09:13:32.747 INFO:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2019-11-25T09:13:32.813 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Linux" 2019-11-25T09:13:32.813 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="7 (Core)" 2019-11-25T09:13:32.813 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2019-11-25T09:13:32.814 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2019-11-25T09:13:32.814 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="7" 2019-11-25T09:13:32.814 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-25T09:13:32.814 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2019-11-25T09:13:32.814 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-25T09:13:32.814 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.centos.org/" 2019-11-25T09:13:32.814 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-25T09:13:32.814 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:32.815 INFO:teuthology.orchestra.run.smithi135.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-25T09:13:32.815 INFO:teuthology.orchestra.run.smithi135.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-25T09:13:32.815 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-25T09:13:32.815 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-25T09:13:32.815 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:32.816 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2019-11-25T09:13:32.833 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2019-11-25T09:13:32.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:13:32.834 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:13:32.937 INFO:teuthology.orchestra.run.smithi174:> true 2019-11-25T09:13:33.362 INFO:teuthology.orchestra.run.smithi174:> uname -m 2019-11-25T09:13:33.440 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2019-11-25T09:13:33.441 INFO:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2019-11-25T09:13:33.525 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Linux" 2019-11-25T09:13:33.525 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="7 (Core)" 2019-11-25T09:13:33.525 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2019-11-25T09:13:33.525 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2019-11-25T09:13:33.526 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="7" 2019-11-25T09:13:33.526 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-25T09:13:33.526 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2019-11-25T09:13:33.526 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-25T09:13:33.526 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.centos.org/" 2019-11-25T09:13:33.526 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-25T09:13:33.526 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:13:33.527 INFO:teuthology.orchestra.run.smithi174.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-25T09:13:33.527 INFO:teuthology.orchestra.run.smithi174.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-25T09:13:33.527 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-25T09:13:33.527 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-25T09:13:33.527 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:13:33.528 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2019-11-25T09:13:33.553 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-11-25T09:13:33.592 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi135.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDW1IhJLIpt7+JzxO/Pejcae9ZACyO0PfqO8jzr+foHSgViAiaoVyibr/dLiWXAQOW3D1QypMDAQ2GeWGIqx6eUaTduwZr4pccohCUbPsjoj1C8c8CDA8v67cNWiaZ242+j6cHhJxMc3V62cPiXsETR/QZ/5NEoMIyskxsTMcBXQCWl7vXG78jIOmNzHKE8MxPsbJNeUzURzUQTiU7MJ2vRCoDp/qMF0cUcmFs9yT3n81T7FsTz2fiyIOzlGFWTRyK22465HPPR+5gBTAFgfiHQRWD09yW76xJtTZQEs2HrcYNrfvFL+Xq5v2QGtnR5zHDiVeFUgNvqlqVJvx4t97DL smithi174.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYWtHFbSToIn0xynJX+mC3n82/ROM8vgE9TBXtsuPFJ2HeBbusDqAUxSP6032zAz/60pFHf83FEJsEKvwfCxVqkVKVUt7IfUkQLPGBzLnrKmeqb+vri/FbiFTW+Tyoj95W/NDwA8WpYTwQ1x9VcW+gBesWIDEJ/CbjunG4yl4RHe3yDpyF6LDcX+w7Dly6j+DLSqjZdH2gKqo3Qt2l+SfCfd04Z/svxdV8Vu7+GbaV9NYMAOzVrUwH/7xXxFFqbukPJ320iVZoVemiCTj9qeNX83u5uazlupW7RevGPTZitNnpAfADFxNac7qpso7hHwGKe0/cm011YkAxoLIHgG2p 2019-11-25T09:13:33.592 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-11-25T09:13:33.638 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-11-25T09:13:33.656 INFO:teuthology.task.internal:Saving configuration 2019-11-25T09:13:33.683 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-11-25T09:13:33.727 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-11-25T09:13:33.749 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-25 09:08:41.278907', u'locked_by': u'scheduled_yuvalif@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi135.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCRwnc+kQoy74YDsRKM+MWBvexIgy8QWkyaqb6klWBHXgo2dFUlcqL/oxWm1FdE41Db6DNnxh1tJTb49LLE+goM=', u'description': u'/home/teuthworker/archive/yuvalif-2019-11-25_06:14:24-rgw:verify-wip-yuval-add-kafka-security2-distro-basic-smithi/4542043'} 2019-11-25T09:13:33.763 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-11-25 09:08:41.278927', u'locked_by': u'scheduled_yuvalif@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi174.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHVitplx/6WhQmzVUS+gv8qZ2GiKogx5U6NABUTIxovadaAwn+P3nF2shjbMFSlYWSqG9QqvjImRgrIlkPyaIqk=', u'description': u'/home/teuthworker/archive/yuvalif-2019-11-25_06:14:24-rgw:verify-wip-yuval-add-kafka-security2-distro-basic-smithi/4542043'} 2019-11-25T09:13:33.763 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-11-25T09:13:33.774 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-25T09:13:33.774 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-25T09:13:33.775 INFO:teuthology.run_tasks:Running task console_log... 2019-11-25T09:13:33.934 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-11-25T09:13:33.934 INFO:teuthology.run_tasks:Running task internal.connect... 2019-11-25T09:13:33.948 INFO:teuthology.task.internal:Opening connections... 2019-11-25T09:13:33.949 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:13:33.950 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:13:34.056 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:13:34.057 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:13:34.172 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-11-25T09:13:34.184 INFO:teuthology.orchestra.run.smithi174:> uname -m 2019-11-25T09:13:34.395 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2019-11-25T09:13:34.396 INFO:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2019-11-25T09:13:34.465 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Linux" 2019-11-25T09:13:34.466 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="7 (Core)" 2019-11-25T09:13:34.466 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2019-11-25T09:13:34.466 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2019-11-25T09:13:34.466 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="7" 2019-11-25T09:13:34.466 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-25T09:13:34.466 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2019-11-25T09:13:34.466 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-25T09:13:34.467 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.centos.org/" 2019-11-25T09:13:34.467 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-25T09:13:34.467 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:13:34.467 INFO:teuthology.orchestra.run.smithi174.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-25T09:13:34.467 INFO:teuthology.orchestra.run.smithi174.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-25T09:13:34.467 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-25T09:13:34.467 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-25T09:13:34.468 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:13:34.468 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2019-11-25T09:13:34.492 INFO:teuthology.orchestra.run.smithi135:> uname -m 2019-11-25T09:13:34.615 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2019-11-25T09:13:34.615 INFO:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2019-11-25T09:13:34.710 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Linux" 2019-11-25T09:13:34.710 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="7 (Core)" 2019-11-25T09:13:34.710 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2019-11-25T09:13:34.711 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2019-11-25T09:13:34.711 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="7" 2019-11-25T09:13:34.711 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-11-25T09:13:34.711 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2019-11-25T09:13:34.711 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-11-25T09:13:34.711 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.centos.org/" 2019-11-25T09:13:34.712 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-11-25T09:13:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:34.712 INFO:teuthology.orchestra.run.smithi135.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-11-25T09:13:34.712 INFO:teuthology.orchestra.run.smithi135.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-11-25T09:13:34.712 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-11-25T09:13:34.712 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-11-25T09:13:34.712 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:34.713 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2019-11-25T09:13:34.726 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-11-25T09:13:34.761 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-11-25T09:13:34.780 INFO:teuthology.task.internal:Checking for old test directory... 2019-11-25T09:13:34.780 INFO:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2019-11-25T09:13:34.785 INFO:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2019-11-25T09:13:34.871 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-11-25T09:13:34.917 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-11-25T09:13:34.917 INFO:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2019-11-25T09:13:34.922 INFO:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2019-11-25T09:13:35.026 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-11-25T09:13:35.087 INFO:teuthology.run_tasks:Running task kernel... 2019-11-25T09:13:35.110 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}} 2019-11-25T09:13:35.110 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-11-25T09:13:35.110 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:13:35.111 INFO:teuthology.orchestra.run.smithi174:> sudo package-cleanup -y --oldkernels 2019-11-25T09:13:35.993 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:13:36.986 INFO:teuthology.orchestra.run.smithi174.stdout:http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/733703470dd10accd9234492acb0c74de09f91772c2767107f6b0fa567cbc26a-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-11-25T09:13:36.986 INFO:teuthology.orchestra.run.smithi174.stdout:Trying other mirror. 2019-11-25T09:13:36.986 INFO:teuthology.orchestra.run.smithi174.stdout:To address this issue please refer to the below wiki article 2019-11-25T09:13:36.986 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:13:36.986 INFO:teuthology.orchestra.run.smithi174.stdout:https://wiki.centos.org/yum-errors 2019-11-25T09:13:36.986 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:13:36.987 INFO:teuthology.orchestra.run.smithi174.stdout:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2019-11-25T09:13:36.987 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:13:37.132 INFO:teuthology.orchestra.run.smithi174.stdout:http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/733703470dd10accd9234492acb0c74de09f91772c2767107f6b0fa567cbc26a-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-11-25T09:13:37.133 INFO:teuthology.orchestra.run.smithi174.stdout:Trying other mirror. 2019-11-25T09:13:37.232 INFO:teuthology.orchestra.run.smithi174.stdout:http://mirror.oss.ou.edu/epel/7/x86_64/repodata/733703470dd10accd9234492acb0c74de09f91772c2767107f6b0fa567cbc26a-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-11-25T09:13:37.232 INFO:teuthology.orchestra.run.smithi174.stdout:Trying other mirror. 2019-11-25T09:13:37.378 INFO:teuthology.orchestra.run.smithi174.stdout:http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/733703470dd10accd9234492acb0c74de09f91772c2767107f6b0fa567cbc26a-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-11-25T09:13:37.378 INFO:teuthology.orchestra.run.smithi174.stdout:Trying other mirror. 2019-11-25T09:13:37.529 INFO:teuthology.orchestra.run.smithi174.stdout:http://mirror.pnl.gov/epel/7/x86_64/repodata/733703470dd10accd9234492acb0c74de09f91772c2767107f6b0fa567cbc26a-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-11-25T09:13:37.529 INFO:teuthology.orchestra.run.smithi174.stdout:Trying other mirror. 2019-11-25T09:13:39.197 INFO:teuthology.orchestra.run.smithi174.stdout:No old kernels to remove 2019-11-25T09:13:39.217 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:13:39.217 INFO:teuthology.orchestra.run.smithi135:> sudo package-cleanup -y --oldkernels 2019-11-25T09:13:40.108 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:13:41.069 INFO:teuthology.orchestra.run.smithi135.stdout:http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/733703470dd10accd9234492acb0c74de09f91772c2767107f6b0fa567cbc26a-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-11-25T09:13:41.070 INFO:teuthology.orchestra.run.smithi135.stdout:Trying other mirror. 2019-11-25T09:13:41.070 INFO:teuthology.orchestra.run.smithi135.stdout:To address this issue please refer to the below wiki article 2019-11-25T09:13:41.070 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:41.070 INFO:teuthology.orchestra.run.smithi135.stdout:https://wiki.centos.org/yum-errors 2019-11-25T09:13:41.071 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:41.071 INFO:teuthology.orchestra.run.smithi135.stdout:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2019-11-25T09:13:41.072 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:41.220 INFO:teuthology.orchestra.run.smithi135.stdout:http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/733703470dd10accd9234492acb0c74de09f91772c2767107f6b0fa567cbc26a-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-11-25T09:13:41.221 INFO:teuthology.orchestra.run.smithi135.stdout:Trying other mirror. 2019-11-25T09:13:41.312 INFO:teuthology.orchestra.run.smithi135.stdout:http://mirror.oss.ou.edu/epel/7/x86_64/repodata/733703470dd10accd9234492acb0c74de09f91772c2767107f6b0fa567cbc26a-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-11-25T09:13:41.313 INFO:teuthology.orchestra.run.smithi135.stdout:Trying other mirror. 2019-11-25T09:13:41.456 INFO:teuthology.orchestra.run.smithi135.stdout:http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/733703470dd10accd9234492acb0c74de09f91772c2767107f6b0fa567cbc26a-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-11-25T09:13:41.456 INFO:teuthology.orchestra.run.smithi135.stdout:Trying other mirror. 2019-11-25T09:13:41.609 INFO:teuthology.orchestra.run.smithi135.stdout:http://mirror.pnl.gov/epel/7/x86_64/repodata/733703470dd10accd9234492acb0c74de09f91772c2767107f6b0fa567cbc26a-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-11-25T09:13:41.609 INFO:teuthology.orchestra.run.smithi135.stdout:Trying other mirror. 2019-11-25T09:13:43.285 INFO:teuthology.orchestra.run.smithi135.stdout:No old kernels to remove 2019-11-25T09:13:43.305 INFO:teuthology.orchestra.run.smithi135:> uname -r 2019-11-25T09:13:43.397 INFO:teuthology.orchestra.run.smithi135.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-25T09:13:43.398 INFO:teuthology.task.kernel:Running kernel on smithi135: 3.10.0-1062.4.1.el7.x86_64 2019-11-25T09:13:43.398 INFO:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2019-11-25T09:13:43.643 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:13:43.684 INFO:teuthology.orchestra.run.smithi135.stdout:Determining fastest mirrors 2019-11-25T09:13:43.843 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:13:43.843 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: ftp.linux.ncsu.edu 2019-11-25T09:13:43.844 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:13:43.845 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:13:45.076 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:13:45.077 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:13:45.078 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-25T09:13:46.307 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:13:47.142 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:47.142 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:13:47.143 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:47.144 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:13:47.144 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2019-11-25T09:13:47.144 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:13:47.144 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:13:47.144 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-25T09:13:47.144 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:47.145 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:13:47.145 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:13:47.145 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2019-11-25T09:13:47.145 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:13:47.145 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 50 M 2019-11-25T09:13:47.146 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 64 M 2019-11-25T09:13:47.146 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:13:47.151 INFO:teuthology.orchestra.run.smithi135.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-25T09:13:48.337 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:13:48.524 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:13:49.475 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:13:49.475 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:14:24.658 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-25T09:14:25.270 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-25T09:14:25.271 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:14:25.271 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:14:25.271 INFO:teuthology.orchestra.run.smithi135.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-25T09:14:25.271 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:14:25.271 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:14:25.320 INFO:teuthology.orchestra.run.smithi135:> rpm -q kernel --last | head -n 1 2019-11-25T09:14:25.718 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Mon 25 Nov 2019 09:13:52 AM UTC 2019-11-25T09:14:25.719 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:14:25.720 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:14:25.720 INFO:teuthology.orchestra.run.smithi174:> uname -r 2019-11-25T09:14:25.834 INFO:teuthology.orchestra.run.smithi174.stdout:3.10.0-1062.4.1.el7.x86_64 2019-11-25T09:14:25.834 INFO:teuthology.task.kernel:Running kernel on smithi174: 3.10.0-1062.4.1.el7.x86_64 2019-11-25T09:14:25.834 INFO:teuthology.orchestra.run.smithi174:> sudo yum install -y kernel 2019-11-25T09:14:26.123 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:14:26.170 INFO:teuthology.orchestra.run.smithi174.stdout:Determining fastest mirrors 2019-11-25T09:14:26.331 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:14:26.332 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: ftp.linux.ncsu.edu 2019-11-25T09:14:26.332 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:14:26.333 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.trouble-free.net 2019-11-25T09:14:27.775 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:14:27.776 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:14:27.776 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package kernel.x86_64 0:3.10.0-1062.4.3.el7 will be installed 2019-11-25T09:14:29.093 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:14:29.957 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:14:29.957 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:14:29.961 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:14:29.961 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:14:29.961 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2019-11-25T09:14:29.961 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:14:29.961 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:14:29.961 INFO:teuthology.orchestra.run.smithi174.stdout: kernel x86_64 3.10.0-1062.4.3.el7 updates 50 M 2019-11-25T09:14:29.961 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:14:29.962 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:14:29.962 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:14:29.962 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2019-11-25T09:14:29.962 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:14:29.962 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 50 M 2019-11-25T09:14:29.962 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 64 M 2019-11-25T09:14:29.962 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:14:29.966 INFO:teuthology.orchestra.run.smithi174.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-25T09:14:31.939 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:14:32.137 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:14:33.133 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:14:33.134 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:15:08.041 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-25T09:15:08.548 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : kernel-3.10.0-1062.4.3.el7.x86_64 1/1 2019-11-25T09:15:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:15:08.549 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:15:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: kernel.x86_64 0:3.10.0-1062.4.3.el7 2019-11-25T09:15:08.549 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:15:08.549 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:15:08.597 INFO:teuthology.orchestra.run.smithi174:> rpm -q kernel --last | head -n 1 2019-11-25T09:15:08.926 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Mon 25 Nov 2019 09:14:35 AM UTC 2019-11-25T09:15:08.928 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:15:08.928 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:15:08.928 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-11-25T09:15:08.929 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-25T09:15:08.929 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-11-25T09:15:08.929 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-11-25T09:15:08.929 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2019-11-25T09:15:08.929 INFO:teuthology.orchestra.run.smithi135:> rpm -q kernel --last | head -n 1 2019-11-25T09:15:09.296 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Mon 25 Nov 2019 09:13:52 AM UTC 2019-11-25T09:15:09.298 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:15:09.298 INFO:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2 2019-11-25T09:15:09.437 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2 2019-11-25T09:15:09.438 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2019-11-25T09:15:09.438 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.02 2019-11-25T09:15:09.438 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 0.76.el7.centos 2019-11-25T09:15:09.439 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2019-11-25T09:15:09.439 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-25T09:15:09.439 INFO:teuthology.orchestra.run.smithi135.stdout:Group : System Environment/Base 2019-11-25T09:15:09.439 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 0 2019-11-25T09:15:09.439 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2019-11-25T09:15:09.440 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-25T09:15:09.440 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-25T09:15:09.440 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-25T09:15:09.440 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-25T09:15:09.441 INFO:teuthology.orchestra.run.smithi135.stdout:Relocations : (not relocatable) 2019-11-25T09:15:09.441 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : CentOS BuildSystem 2019-11-25T09:15:09.441 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2019-11-25T09:15:09.441 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-25T09:15:09.442 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-25T09:15:09.442 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2019-11-25T09:15:09.442 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:15:09.442 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-25T09:15:09.443 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-25T09:15:09.443 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-25T09:15:09.443 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2019-11-25T09:15:09.445 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-25T09:15:09.445 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:15:09.445 INFO:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-25T09:15:09.954 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2019-11-25T09:15:10.094 INFO:teuthology.orchestra.run.smithi135.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:15:10.109 INFO:teuthology.orchestra.run.smithi135.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-25T09:15:10.341 INFO:teuthology.orchestra.run.smithi135.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-25T09:15:10.361 INFO:teuthology.orchestra.run.smithi135.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-25T09:15:10.394 INFO:teuthology.orchestra.run.smithi135.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-25T09:15:10.410 INFO:teuthology.orchestra.run.smithi135.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-25T09:15:10.437 INFO:teuthology.orchestra.run.smithi135.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-25T09:15:10.446 INFO:teuthology.orchestra.run.smithi135.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-25T09:15:11.576 INFO:teuthology.orchestra.run.smithi135.stderr:done 2019-11-25T09:15:11.578 INFO:teuthology.orchestra.run.smithi135:> mktemp 2019-11-25T09:15:11.740 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.2YN0OLtdcl 2019-11-25T09:15:11.740 INFO:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2YN0OLtdcl 2019-11-25T09:15:11.839 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.2YN0OLtdcl 2019-11-25T09:15:11.989 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.2YN0OLtdcl is 6KB 2019-11-25T09:15:12.052 INFO:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.2YN0OLtdcl 2019-11-25T09:15:12.108 INFO:teuthology.orchestra.run.smithi135:> sudo grub2-set-default 0 2019-11-25T09:15:12.376 INFO:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2019-11-25T09:15:12.382 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-11-25T09:15:12.382 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi174.front.sepia.ceph.com, path=None, version=distro) 2019-11-25T09:15:12.382 INFO:teuthology.orchestra.run.smithi174:> rpm -q kernel --last | head -n 1 2019-11-25T09:15:12.749 INFO:teuthology.orchestra.run.smithi174.stdout:kernel-3.10.0-1062.4.3.el7.x86_64 Mon 25 Nov 2019 09:14:35 AM UTC 2019-11-25T09:15:12.752 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:15:12.752 INFO:teuthology.orchestra.run.smithi174:> sudo rpm -qi grub2 2019-11-25T09:15:12.867 INFO:teuthology.orchestra.run.smithi174.stdout:Name : grub2 2019-11-25T09:15:12.869 INFO:teuthology.orchestra.run.smithi174.stdout:Epoch : 1 2019-11-25T09:15:12.869 INFO:teuthology.orchestra.run.smithi174.stdout:Version : 2.02 2019-11-25T09:15:12.870 INFO:teuthology.orchestra.run.smithi174.stdout:Release : 0.76.el7.centos 2019-11-25T09:15:12.870 INFO:teuthology.orchestra.run.smithi174.stdout:Architecture: x86_64 2019-11-25T09:15:12.870 INFO:teuthology.orchestra.run.smithi174.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-11-25T09:15:12.870 INFO:teuthology.orchestra.run.smithi174.stdout:Group : System Environment/Base 2019-11-25T09:15:12.870 INFO:teuthology.orchestra.run.smithi174.stdout:Size : 0 2019-11-25T09:15:12.870 INFO:teuthology.orchestra.run.smithi174.stdout:License : GPLv3+ 2019-11-25T09:15:12.870 INFO:teuthology.orchestra.run.smithi174.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-11-25T09:15:12.871 INFO:teuthology.orchestra.run.smithi174.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-11-25T09:15:12.871 INFO:teuthology.orchestra.run.smithi174.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-11-25T09:15:12.871 INFO:teuthology.orchestra.run.smithi174.stdout:Build Host : kbuilder.bsys.centos.org 2019-11-25T09:15:12.871 INFO:teuthology.orchestra.run.smithi174.stdout:Relocations : (not relocatable) 2019-11-25T09:15:12.871 INFO:teuthology.orchestra.run.smithi174.stdout:Packager : CentOS BuildSystem 2019-11-25T09:15:12.871 INFO:teuthology.orchestra.run.smithi174.stdout:Vendor : CentOS 2019-11-25T09:15:12.871 INFO:teuthology.orchestra.run.smithi174.stdout:URL : http://www.gnu.org/software/grub/ 2019-11-25T09:15:12.872 INFO:teuthology.orchestra.run.smithi174.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-11-25T09:15:12.872 INFO:teuthology.orchestra.run.smithi174.stdout:Description : 2019-11-25T09:15:12.872 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:15:12.872 INFO:teuthology.orchestra.run.smithi174.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-11-25T09:15:12.872 INFO:teuthology.orchestra.run.smithi174.stdout:customizable bootloader with modular architecture. It supports a rich 2019-11-25T09:15:12.872 INFO:teuthology.orchestra.run.smithi174.stdout:variety of kernel formats, file systems, computer architectures and 2019-11-25T09:15:12.872 INFO:teuthology.orchestra.run.smithi174.stdout:hardware devices. 2019-11-25T09:15:12.875 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-11-25T09:15:12.875 INFO:teuthology.task.kernel:Updating grub on smithi174 to boot 3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:15:12.876 INFO:teuthology.orchestra.run.smithi174:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-11-25T09:15:13.344 INFO:teuthology.orchestra.run.smithi174.stderr:Generating grub configuration file ... 2019-11-25T09:15:13.485 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:15:13.519 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.3.el7.x86_64.img 2019-11-25T09:15:13.749 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-11-25T09:15:13.784 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-11-25T09:15:13.825 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-11-25T09:15:13.847 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-11-25T09:15:13.878 INFO:teuthology.orchestra.run.smithi174.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-11-25T09:15:13.888 INFO:teuthology.orchestra.run.smithi174.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-11-25T09:15:14.894 INFO:teuthology.orchestra.run.smithi174.stderr:done 2019-11-25T09:15:14.894 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-25T09:15:14.950 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.YJzrhsZKpB 2019-11-25T09:15:14.951 INFO:teuthology.orchestra.run.smithi174:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YJzrhsZKpB 2019-11-25T09:15:15.029 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.YJzrhsZKpB 2019-11-25T09:15:15.234 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.YJzrhsZKpB is 6KB 2019-11-25T09:15:15.303 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.YJzrhsZKpB 2019-11-25T09:15:15.365 INFO:teuthology.orchestra.run.smithi174:> sudo grub2-set-default 0 2019-11-25T09:15:15.538 INFO:teuthology.orchestra.run.smithi174:> sudo shutdown -r now 2019-11-25T09:15:15.543 INFO:teuthology.misc:Re-opening connections... 2019-11-25T09:15:15.543 INFO:teuthology.misc:trying to connect to ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:15:15.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:15:15.546 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:15:15.647 INFO:teuthology.orchestra.run.smithi174:> true 2019-11-25T09:15:15.972 DEBUG:teuthology.misc:waited 0.428865909576 2019-11-25T09:15:16.974 INFO:teuthology.misc:trying to connect to ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:15:16.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:15:16.974 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:16:16.976 DEBUG:teuthology.orchestra.remote:timed out 2019-11-25T09:16:16.976 DEBUG:teuthology.misc:waited 61.4329619408 2019-11-25T09:16:17.983 INFO:teuthology.misc:trying to connect to ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:16:17.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:16:17.984 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:16:49.466 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2019-11-25T09:16:49.466 DEBUG:teuthology.misc:waited 93.9225480556 2019-11-25T09:16:50.467 INFO:teuthology.misc:trying to connect to ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:16:50.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:16:50.468 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:16:50.469 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2019-11-25T09:16:50.469 DEBUG:teuthology.misc:waited 94.9253540039 2019-11-25T09:16:51.470 INFO:teuthology.misc:trying to connect to ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:16:51.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:16:51.471 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:16:51.471 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2019-11-25T09:16:51.472 DEBUG:teuthology.misc:waited 95.9282619953 2019-11-25T09:16:52.472 INFO:teuthology.misc:trying to connect to ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:16:52.472 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:16:52.473 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:16:52.558 INFO:teuthology.orchestra.run.smithi135:> true 2019-11-25T09:16:52.948 DEBUG:teuthology.misc:waited 97.4046890736 2019-11-25T09:16:53.950 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-11-25T09:16:53.950 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-25T09:16:53.951 INFO:teuthology.orchestra.run.smithi135:> uname -r 2019-11-25T09:16:54.025 INFO:teuthology.orchestra.run.smithi135.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:16:54.025 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:16:54.025 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-25T09:16:54.026 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-11-25T09:16:54.026 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-25T09:16:54.026 INFO:teuthology.orchestra.run.smithi174:> uname -r 2019-11-25T09:16:54.027 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-11-25T09:16:54.028 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 695, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 184, in need_to_install stdout=uname_fp, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 199, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 428, in run r.execute() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 98, in execute self.client.exec_command(self.command) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/client.py", line 493, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 806, in open_session timeout=timeout, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/transport.py", line 933, in open_channel raise e error: [Errno 104] Connection reset by peer 2019-11-25T09:16:55.030 INFO:teuthology.misc:Re-opening connections... 2019-11-25T09:16:55.031 INFO:teuthology.misc:trying to connect to ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:16:55.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:16:55.031 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:16:55.130 INFO:teuthology.orchestra.run.smithi174:> true 2019-11-25T09:16:55.473 DEBUG:teuthology.misc:waited 0.442129135132 2019-11-25T09:16:56.474 INFO:teuthology.misc:trying to connect to ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:16:56.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:16:56.476 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:16:56.587 INFO:teuthology.orchestra.run.smithi135:> true 2019-11-25T09:16:56.849 DEBUG:teuthology.misc:waited 1.81858205795 2019-11-25T09:16:57.850 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-11-25T09:16:57.850 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.4.3.el7.x86_64"... 2019-11-25T09:16:57.851 INFO:teuthology.orchestra.run.smithi174:> uname -r 2019-11-25T09:16:57.915 INFO:teuthology.orchestra.run.smithi174.stdout:3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:16:57.916 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.4.3.el7.x86_64 2019-11-25T09:16:57.916 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-11-25T09:16:58.916 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-11-25T09:16:58.917 INFO:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-25T09:16:59.008 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2019-11-25T09:16:59.020 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-11-25T09:16:59.021 INFO:teuthology.orchestra.run.smithi174:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-11-25T09:16:59.098 INFO:teuthology.orchestra.run.smithi174.stdout:ttyS1 2019-11-25T09:16:59.118 INFO:teuthology.run_tasks:Running task internal.base... 2019-11-25T09:16:59.161 INFO:teuthology.task.internal:Creating test directory... 2019-11-25T09:16:59.161 INFO:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-25T09:16:59.169 INFO:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-11-25T09:16:59.213 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-11-25T09:16:59.226 INFO:teuthology.run_tasks:Running task internal.archive... 2019-11-25T09:16:59.281 INFO:teuthology.task.internal:Creating archive directory... 2019-11-25T09:16:59.281 INFO:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-25T09:16:59.287 INFO:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-11-25T09:16:59.356 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-11-25T09:16:59.392 INFO:teuthology.task.internal:Enabling coredump saving... 2019-11-25T09:16:59.393 INFO:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-25T09:16:59.404 INFO:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-25T09:16:59.468 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-25T09:16:59.485 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-11-25T09:16:59.487 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-11-25T09:16:59.498 INFO:teuthology.task.internal:Configuring sudo... 2019-11-25T09:16:59.498 INFO:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-25T09:16:59.502 INFO:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-11-25T09:16:59.558 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-11-25T09:16:59.591 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-11-25T09:16:59.591 INFO:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-25T09:16:59.595 INFO:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-11-25T09:16:59.635 INFO:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-25T09:16:59.761 INFO:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-25T09:16:59.844 INFO:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-25T09:16:59.912 INFO:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-25T09:16:59.985 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-25T09:17:00.039 INFO:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-25T09:17:00.111 INFO:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-11-25T09:17:00.186 INFO:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-25T09:17:00.251 INFO:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-11-25T09:17:00.313 INFO:teuthology.orchestra.run.smithi135:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-11-25T09:17:00.368 INFO:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2019-11-25T09:17:00.438 INFO:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2019-11-25T09:17:00.579 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-25T09:17:00.591 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-11-25T09:17:00.625 INFO:teuthology.run_tasks:Running task internal.timer... 2019-11-25T09:17:00.635 INFO:teuthology.task.internal:Starting timer... 2019-11-25T09:17:00.635 INFO:teuthology.run_tasks:Running task pcp... 2019-11-25T09:17:00.677 INFO:teuthology.run_tasks:Running task selinux... 2019-11-25T09:17:00.689 INFO:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2019-11-25T09:17:00.793 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: [ OK ] 2019-11-25T09:17:00.795 INFO:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2019-11-25T09:17:00.940 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: [ OK ] 2019-11-25T09:17:00.940 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-11-25T09:17:00.941 INFO:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2019-11-25T09:17:01.006 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2019-11-25T09:17:01.006 INFO:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2019-11-25T09:17:01.089 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2019-11-25T09:17:01.089 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi135.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2019-11-25T09:17:01.089 INFO:teuthology.orchestra.run.smithi174:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-25T09:17:01.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-25T09:17:01.163 INFO:teuthology.orchestra.run.smithi135:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-11-25T09:17:01.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-25T09:17:01.258 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-11-25T09:17:01.258 INFO:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2019-11-25T09:17:01.371 INFO:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2019-11-25T09:17:01.480 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-11-25T09:17:01.495 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2019-11-25T09:17:01.525 INFO:teuthology.repo_utils:Fetching master from origin 2019-11-25T09:17:01.611 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-11-25T09:17:01.660 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-11-25T09:17:01.663 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi174.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-11-25T09:17:02.120 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-11-25T09:17:06.159 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-11-25T09:17:06.184 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:06 +0000 (0:00:00.067) 0:00:00.067 ******* 2019-11-25T09:17:06.202 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:06 +0000 (0:00:00.017) 0:00:00.085 ******* 2019-11-25T09:17:09.483 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi174.front.sepia.ceph.com] 2019-11-25T09:17:09.565 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:09 +0000 (0:00:03.363) 0:00:03.449 ******* 2019-11-25T09:17:09.626 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] 2019-11-25T09:17:09.721 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:09 +0000 (0:00:00.153) 0:00:03.602 ******* 2019-11-25T09:17:10.010 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-11-25T09:17:10.012 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-25T09:17:10.049 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:10 +0000 (0:00:00.330) 0:00:03.932 ******* 2019-11-25T09:17:10.056 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-25T09:17:10.094 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:10 +0000 (0:00:00.044) 0:00:03.977 ******* 2019-11-25T09:17:10.668 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-11-25T09:17:10.670 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-25T09:17:10.710 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:10 +0000 (0:00:00.616) 0:00:04.594 ******* 2019-11-25T09:17:10.720 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-11-25T09:17:10.760 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:10 +0000 (0:00:00.049) 0:00:04.644 ******* 2019-11-25T09:17:10.765 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-11-25T09:17:10.765 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:10.812 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:10 +0000 (0:00:00.051) 0:00:04.695 ******* 2019-11-25T09:17:10.819 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:10.860 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:10 +0000 (0:00:00.048) 0:00:04.743 ******* 2019-11-25T09:17:11.262 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-25T09:17:11.319 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:11 +0000 (0:00:00.457) 0:00:05.201 ******* 2019-11-25T09:17:11.331 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-25T09:17:11.374 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:11 +0000 (0:00:00.056) 0:00:05.258 ******* 2019-11-25T09:17:12.813 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-11-25T09:17:12.813 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574673431.39-57262682564055/source", "state": "file", "uid": 0} 2019-11-25T09:17:12.849 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:12 +0000 (0:00:01.475) 0:00:06.733 ******* 2019-11-25T09:17:12.855 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574673431.36-85929912911221/source", "state": "file", "uid": 0} 2019-11-25T09:17:12.902 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:12 +0000 (0:00:00.046) 0:00:06.780 ******* 2019-11-25T09:17:13.352 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:13.470 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:13.677 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:13.805 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:14.000 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:14.081 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:14.330 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:14.418 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:14.669 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:14.741 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:14.946 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:15.031 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:15.269 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:15.384 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-11-25T09:17:15.494 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-11-25T09:17:15.500 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-11-25T09:17:15.698 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:15 +0000 (0:00:02.802) 0:00:09.582 ******* 2019-11-25T09:17:15.733 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:15 +0000 (0:00:00.034) 0:00:09.617 ******* 2019-11-25T09:17:16.578 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi135.front.sepia.ceph.com] 2019-11-25T09:17:16.669 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-11-25T09:17:16.670 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:16 +0000 (0:00:00.935) 0:00:10.552 ******* 2019-11-25T09:17:16.682 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] 2019-11-25T09:17:16.768 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:16 +0000 (0:00:00.099) 0:00:10.652 ******* 2019-11-25T09:17:17.202 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-11-25T09:17:17.203 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.217497", "end": "2019-11-25 09:17:17.173058", "rc": 0, "start": "2019-11-25 09:17:16.955561", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-25T09:17:17.257 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:17 +0000 (0:00:00.488) 0:00:11.140 ******* 2019-11-25T09:17:17.267 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.216098", "end": "2019-11-25 09:17:17.194473", "rc": 0, "start": "2019-11-25 09:17:16.978375", "stderr": "", "stderr_lines": [], "stdout": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "stdout_lines": ["4334b3798f2061758a627b6bdd54d0cd6b822faa"]} 2019-11-25T09:17:17.310 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:17 +0000 (0:00:00.053) 0:00:11.194 ******* 2019-11-25T09:17:17.608 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-11-25T09:17:17.609 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.017397", "end": "2019-11-25 09:17:17.569648", "failed_when_result": false, "rc": 0, "start": "2019-11-25 09:17:17.552251", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-25T09:17:17.652 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:17 +0000 (0:00:00.341) 0:00:11.536 ******* 2019-11-25T09:17:17.666 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013574", "end": "2019-11-25 09:17:17.593457", "failed_when_result": false, "rc": 0, "start": "2019-11-25 09:17:17.579883", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-11-25T09:17:17.710 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:17 +0000 (0:00:00.057) 0:00:11.593 ******* 2019-11-25T09:17:17.716 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-11-25T09:17:17.717 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:17.771 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:17 +0000 (0:00:00.061) 0:00:11.655 ******* 2019-11-25T09:17:17.784 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:17.818 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:17 +0000 (0:00:00.045) 0:00:11.700 ******* 2019-11-25T09:17:17.823 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-11-25T09:17:17.824 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:17.863 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:17 +0000 (0:00:00.046) 0:00:11.746 ******* 2019-11-25T09:17:17.871 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:17.931 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:17 +0000 (0:00:00.068) 0:00:11.815 ******* 2019-11-25T09:17:17.938 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-11-25T09:17:17.939 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:18.000 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:17 +0000 (0:00:00.068) 0:00:11.884 ******* 2019-11-25T09:17:18.010 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:18.056 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:18 +0000 (0:00:00.055) 0:00:11.940 ******* 2019-11-25T09:17:18.066 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:18.114 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:18 +0000 (0:00:00.057) 0:00:11.998 ******* 2019-11-25T09:17:18.123 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:18.174 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:18 +0000 (0:00:00.059) 0:00:12.058 ******* 2019-11-25T09:17:18.180 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-11-25T09:17:18.181 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:18.222 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:18 +0000 (0:00:00.048) 0:00:12.106 ******* 2019-11-25T09:17:18.229 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:17:18.275 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:18 +0000 (0:00:00.052) 0:00:12.159 ******* 2019-11-25T09:17:18.568 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* ok: [smithi135.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-25T09:17:18.617 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:18 +0000 (0:00:00.331) 0:00:12.490 ******* 2019-11-25T09:17:18.642 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:18 +0000 (0:00:00.034) 0:00:12.525 ******* 2019-11-25T09:17:18.986 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-11-25T09:17:18.988 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-25T09:17:19.044 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-11-25T09:17:19.294 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-25T09:17:19.357 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-11-25T09:17:19.599 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-25T09:17:19.684 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-11-25T09:17:19.920 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-25T09:17:20.000 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-11-25T09:17:20.264 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-25T09:17:20.348 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-11-25T09:17:20.600 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-25T09:17:20.684 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-11-25T09:17:20.937 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-25T09:17:21.038 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-11-25T09:17:21.277 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-25T09:17:21.353 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-11-25T09:17:21.585 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-25T09:17:21.692 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-11-25T09:17:21.924 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-25T09:17:22.031 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-11-25T09:17:22.231 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-25T09:17:22.340 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-11-25T09:17:22.545 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-25T09:17:22.666 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-11-25T09:17:22.827 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-25T09:17:22.996 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/sbillah", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "move_home": false, "name": "sbillah", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-11-25T09:17:23.109 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-25T09:17:23.337 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-11-25T09:17:23.464 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-25T09:17:23.684 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-11-25T09:17:23.760 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-25T09:17:24.026 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-11-25T09:17:24.081 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-25T09:17:24.355 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-11-25T09:17:24.429 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-25T09:17:24.679 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-11-25T09:17:24.796 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-25T09:17:25.019 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-11-25T09:17:25.168 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-25T09:17:25.343 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-11-25T09:17:25.494 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-25T09:17:25.659 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-11-25T09:17:25.821 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-25T09:17:25.992 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-11-25T09:17:26.164 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-25T09:17:26.343 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-11-25T09:17:26.486 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-25T09:17:26.712 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-11-25T09:17:26.833 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-25T09:17:27.053 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-11-25T09:17:27.185 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-25T09:17:27.393 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-11-25T09:17:27.530 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-25T09:17:27.708 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-11-25T09:17:27.900 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-25T09:17:28.035 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-11-25T09:17:28.199 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-25T09:17:28.357 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-11-25T09:17:28.505 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-25T09:17:28.611 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-11-25T09:17:28.881 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-25T09:17:28.961 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-11-25T09:17:29.198 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-25T09:17:29.252 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-11-25T09:17:29.527 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-25T09:17:29.582 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-11-25T09:17:29.831 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-25T09:17:29.904 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-11-25T09:17:30.168 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-25T09:17:30.202 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jj", "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "move_home": false, "name": "jj", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-11-25T09:17:30.487 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-25T09:17:30.561 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-11-25T09:17:30.783 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-25T09:17:30.895 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-11-25T09:17:31.102 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-25T09:17:31.240 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-11-25T09:17:31.445 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-25T09:17:31.580 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-11-25T09:17:31.796 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-25T09:17:31.897 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-11-25T09:17:32.099 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-25T09:17:32.214 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-11-25T09:17:32.439 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-25T09:17:32.512 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-25T09:17:32.765 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-25T09:17:32.820 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-11-25T09:17:33.075 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-25T09:17:33.097 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-11-25T09:17:33.400 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-25T09:17:33.402 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhishekvrshny", "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "move_home": false, "name": "abhishekvrshny", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-11-25T09:17:33.699 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-25T09:17:33.758 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-11-25T09:17:34.066 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-25T09:17:34.117 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-11-25T09:17:34.350 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-25T09:17:34.448 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-11-25T09:17:34.663 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-25T09:17:34.779 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/shehbazj", "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "move_home": false, "name": "shehbazj", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-11-25T09:17:34.983 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-25T09:17:35.123 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-11-25T09:17:35.324 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-25T09:17:35.478 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/fche", "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "move_home": false, "name": "fche", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-11-25T09:17:35.667 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-25T09:17:35.804 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/onyb", "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "move_home": false, "name": "onyb", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-11-25T09:17:36.017 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-25T09:17:36.181 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-11-25T09:17:36.336 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-25T09:17:36.495 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/oprypin", "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "move_home": false, "name": "oprypin", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-11-25T09:17:36.674 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-25T09:17:36.833 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-25T09:17:37.022 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-25T09:17:37.208 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-11-25T09:17:37.386 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-25T09:17:37.546 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-11-25T09:17:37.761 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-25T09:17:37.916 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-11-25T09:17:38.095 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-25T09:17:38.264 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-11-25T09:17:38.430 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-25T09:17:38.600 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/asheplyakov", "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "move_home": false, "name": "asheplyakov", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-11-25T09:17:38.783 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-25T09:17:38.935 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-11-25T09:17:39.131 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-25T09:17:39.257 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-11-25T09:17:39.480 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-25T09:17:39.618 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-11-25T09:17:39.778 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-25T09:17:39.969 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-11-25T09:17:40.117 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-25T09:17:40.314 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-11-25T09:17:40.463 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-25T09:17:40.659 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/jwilliamson", "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "move_home": false, "name": "jwilliamson", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-11-25T09:17:40.778 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-25T09:17:41.012 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-11-25T09:17:41.118 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-25T09:17:41.340 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-11-25T09:17:41.476 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-25T09:17:41.680 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-11-25T09:17:41.804 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-25T09:17:42.022 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-11-25T09:17:42.142 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-25T09:17:42.352 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-11-25T09:17:42.477 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-25T09:17:42.701 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-11-25T09:17:42.847 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-25T09:17:43.035 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/liupan", "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "move_home": false, "name": "liupan", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-11-25T09:17:43.204 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-25T09:17:43.353 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-11-25T09:17:43.543 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-25T09:17:43.695 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/amarangone", "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "move_home": false, "name": "amarangone", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-11-25T09:17:43.885 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-25T09:17:44.035 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-11-25T09:17:44.257 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-25T09:17:44.381 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/kmroz", "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "move_home": false, "name": "kmroz", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-11-25T09:17:44.613 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-25T09:17:44.711 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-11-25T09:17:44.955 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-25T09:17:45.048 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-11-25T09:17:45.305 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-25T09:17:45.424 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-11-25T09:17:45.664 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-25T09:17:45.792 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-11-25T09:17:46.015 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-25T09:17:46.161 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-11-25T09:17:46.372 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-25T09:17:46.501 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-11-25T09:17:46.729 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-25T09:17:46.829 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/adamyanova", "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "move_home": false, "name": "adamyanova", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-11-25T09:17:47.080 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-25T09:17:47.196 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-11-25T09:17:47.436 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-25T09:17:47.527 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-11-25T09:17:47.790 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-25T09:17:47.895 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-11-25T09:17:48.122 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-25T09:17:48.244 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-11-25T09:17:48.474 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-25T09:17:48.601 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-11-25T09:17:48.824 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-25T09:17:48.936 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-11-25T09:17:49.162 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-25T09:17:49.259 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-11-25T09:17:49.527 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-25T09:17:49.597 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-11-25T09:17:49.876 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-25T09:17:49.955 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-11-25T09:17:50.176 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-25T09:17:50.296 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-11-25T09:17:50.552 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-25T09:17:50.627 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-11-25T09:17:50.889 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-25T09:17:50.957 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-11-25T09:17:51.205 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-25T09:17:51.331 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-11-25T09:17:51.550 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-25T09:17:51.651 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-11-25T09:17:51.886 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-25T09:17:51.957 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-11-25T09:17:52.232 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-25T09:17:52.277 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-11-25T09:17:52.577 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-25T09:17:52.610 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-11-25T09:17:52.911 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-25T09:17:52.955 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-11-25T09:17:53.225 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-25T09:17:53.258 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-11-25T09:17:53.582 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-25T09:17:53.614 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-11-25T09:17:53.918 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-25T09:17:53.929 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-11-25T09:17:54.233 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-25T09:17:54.265 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-11-25T09:17:54.583 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-25T09:17:54.595 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-11-25T09:17:54.919 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-25T09:17:54.922 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-11-25T09:17:55.216 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-25T09:17:55.259 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-11-25T09:17:55.540 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-25T09:17:55.593 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-11-25T09:17:55.865 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-25T09:17:55.929 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-11-25T09:17:56.210 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-25T09:17:56.244 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-11-25T09:17:56.557 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-25T09:17:56.579 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-11-25T09:17:56.859 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-25T09:17:56.892 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-11-25T09:17:57.201 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-11-25T09:17:57.526 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-25T09:17:57.533 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-11-25T09:17:57.862 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-25T09:17:57.884 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-11-25T09:17:58.553 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-25T09:17:58.809 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-11-25T09:17:58.867 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:58 +0000 (0:00:40.224) 0:00:52.750 ******* 2019-11-25T09:17:58.954 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-11-25T09:17:58.993 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:58 +0000 (0:00:00.126) 0:00:52.877 ******* 2019-11-25T09:17:59.030 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:59 +0000 (0:00:00.036) 0:00:52.913 ******* 2019-11-25T09:17:59.083 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:59 +0000 (0:00:00.053) 0:00:52.967 ******* 2019-11-25T09:17:59.112 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz 2019-11-25T09:17:59.120 INFO:teuthology.task.ansible.out:2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57 2019-11-25T09:17:59.128 INFO:teuthology.task.ansible.out:p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 2019-11-25T09:17:59.129 INFO:teuthology.task.ansible.out: 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de993184 2019-11-25T09:17:59.131 INFO:teuthology.task.ansible.out:41c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77 2019-11-25T09:17:59.132 INFO:teuthology.task.ansible.out:a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5e 2019-11-25T09:17:59.134 INFO:teuthology.task.ansible.out:d916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6 2019-11-25T09:17:59.135 INFO:teuthology.task.ansible.out:c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa 2019-11-25T09:17:59.137 INFO:teuthology.task.ansible.out:2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db2 2019-11-25T09:17:59.139 INFO:teuthology.task.ansible.out:93dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.red 2019-11-25T09:17:59.140 INFO:teuthology.task.ansible.out:hat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189 2019-11-25T09:17:59.142 INFO:teuthology.task.ansible.out:"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-25T09:17:59.154 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-11-25T09:17:59.155 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04 2019-11-25T09:17:59.164 INFO:teuthology.task.ansible.out:okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "jos 2019-11-25T09:17:59.166 INFO:teuthology.task.ansible.out:hd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusu 2019-11-25T09:17:59.168 INFO:teuthology.task.ansible.out:i@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab365 2019-11-25T09:17:59.169 INFO:teuthology.task.ansible.out:9115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@de 2019-11-25T09:17:59.170 INFO:teuthology.task.ansible.out:sktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c549779 2019-11-25T09:17:59.172 INFO:teuthology.task.ansible.out:3758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, {"name": "onyb", "ovpn": "ani@orchi 2019-11-25T09:17:59.176 INFO:teuthology.task.ansible.out:d AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxk 2019-11-25T09:17:59.178 INFO:teuthology.task.ansible.out:VdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9z 2019-11-25T09:17:59.179 INFO:teuthology.task.ansible.out:rULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": 2019-11-25T09:17:59.181 INFO:teuthology.task.ansible.out:"swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@th 2019-11-25T09:17:59.182 INFO:teuthology.task.ansible.out:inkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189 2019-11-25T09:17:59.184 INFO:teuthology.task.ansible.out:"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-11-25T09:17:59.227 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:59 +0000 (0:00:00.144) 0:00:53.111 ******* 2019-11-25T09:17:59.267 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:17:59 +0000 (0:00:00.039) 0:00:53.150 ******* 2019-11-25T09:18:00.146 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-11-25T09:18:00.148 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-25T09:18:00.187 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:00 +0000 (0:00:00.920) 0:00:54.071 ******* 2019-11-25T09:18:00.195 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com -> localhost] => {"after": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "attempts": 1, "before": "4334b3798f2061758a627b6bdd54d0cd6b822faa", "changed": false, "remote_url_changed": false} 2019-11-25T09:18:00.236 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:00 +0000 (0:00:00.048) 0:00:54.119 ******* 2019-11-25T09:18:00.608 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-11-25T09:18:00.610 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, " 2019-11-25T09:18:00.611 INFO:teuthology.task.ansible.out:path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-11-25T09:18:00.941 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-25T09:18:00.984 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-11-25T09:18:01.274 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-25T09:18:01.337 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-11-25T09:18:01.598 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-25T09:18:01.682 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-11-25T09:18:01.930 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-25T09:18:01.932 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-25T09:18:02.005 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-11-25T09:18:02.007 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-11-25T09:18:02.286 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-25T09:18:02.385 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-11-25T09:18:02.588 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-25T09:18:02.590 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-25T09:18:02.703 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-11-25T09:18:02.705 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-11-25T09:18:02.905 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-25T09:18:03.031 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-11-25T09:18:03.240 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-11-25T09:18:03.251 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:03.364 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+r 2019-11-25T09:18:03.366 INFO:teuthology.task.ansible.out:R1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:03.577 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-25T09:18:03.579 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-25T09:18:03.588 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:03.610 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:03.620 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:03.632 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:03.689 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-11-25T09:18:03.690 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-11-25T09:18:03.700 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:03.701 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:03.712 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:03.723 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:03.952 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-25T09:18:04.047 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-11-25T09:18:04.277 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-25T09:18:04.279 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-25T09:18:04.382 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-11-25T09:18:04.383 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-11-25T09:18:04.599 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-25T09:18:04.720 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-11-25T09:18:04.939 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-25T09:18:05.048 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-11-25T09:18:05.288 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-25T09:18:05.362 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-11-25T09:18:05.613 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-25T09:18:05.709 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-11-25T09:18:05.949 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-25T09:18:06.045 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-11-25T09:18:06.283 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-25T09:18:06.405 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-11-25T09:18:06.633 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-25T09:18:06.635 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-25T09:18:06.768 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-11-25T09:18:06.770 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-11-25T09:18:06.988 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-25T09:18:06.990 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-25T09:18:07.162 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-11-25T09:18:07.163 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-11-25T09:18:07.322 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-25T09:18:07.531 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-11-25T09:18:07.658 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-25T09:18:07.826 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-11-25T09:18:07.993 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-25T09:18:07.995 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-25T09:18:08.161 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-11-25T09:18:08.163 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-11-25T09:18:08.328 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-25T09:18:08.500 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-11-25T09:18:08.651 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-25T09:18:08.873 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-11-25T09:18:08.989 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-25T09:18:09.209 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-11-25T09:18:09.339 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-25T09:18:09.557 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-11-25T09:18:09.661 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-25T09:18:09.880 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-11-25T09:18:10.027 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-25T09:18:10.028 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-25T09:18:10.234 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-11-25T09:18:10.236 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-11-25T09:18:10.376 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-25T09:18:10.378 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-25T09:18:10.558 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXvd7F0n4DeBROTLYDE4lItYn/2S1cMM1uAkkwissUh4LGsMAVWi5tUI0EUC7I2BUxACvIIA4yfkhe2ATAu95UQxKWVql67sfCW6WwY7lNa65kQC9S5dE/+d4vPxFoFSFnri981laJXOjbjTsWD7j1SGfqbRuAHQKL8y95DQ3y/B7/1oxTg1jjK8BTr3GAUp8/7lNlWE+x2S3gjHqqH92yWU7OBbPWRZjjkVkXS/5CbWDDUx8nbeGPcAIfM95rRQR0VkwzVi1FWsXd6qIbZ9TqOhYyLR0fCsnDuveNV68FB1ddvqCLdXRxPLmucwzdjGMbZ5EJ0H/CAAutj3Vjn6gh jj@newdream.net\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRXOkus/WHB3llEH1u4rWj0F/bZSslq4/o7pBUGFYrHKqa2iBiCj4DxBEsaReWUm0aDyesGuEVeoECTtzh7byJ6iZHFbf0McubxnuFMImneQ2mB0+raa3uWblwnyiwAqiZgtcJGQpCxCnrmLzyNN6xUUmzN27cDOMSDpbWr3VdPSBH+ixIuZI8r8UkSbmlX30V2bvk4lGl2SPV385tAvRPRU9KfMG9AgwNv+R2WCiA2GOrjes2VHm7LneqI/vE5yOxJsm4tPxEkOpCp3/0xt9L9cmPz47HnzJ2Qure3kZmOsCxOX1+9dXFIwhPaNconD4KDlv4MNs/M425Gp6KKnnV jj@laptop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBjrQ3drodiPr83uvpUUf6SXZ0utOFIfy5Cj3BGcn7bY29BKXCwomAUmmLMk76cGBZ7jHf3ZJYid1ESbHmvmSgKFShr9JFXBHvlMdnyewi7hFix+sjX9ZtuZfSaIsBbU5Jlz3RqHtDrScS1wJRh+ 2019-11-25T09:18:10.560 INFO:teuthology.task.ansible.out:oDlH6is5QWSCABVWhUk+hJtQFg4dfespqomt88NmPZuR0aR0b22hkrMYINXP0y3iz3Jjs5vg8td7VJ2hXb5yIBk+Izuq1LnjPyRCZv5LkZMuwofexpfflLKeVHw0t31HXuzBUZMoKqXiGJweyPDzY/xbeTVnYvQQEvoGxRDpaYuiGSfhFW0UHE3HSeuYfklO2x juanjose@aurora", "key_options": null, "keyfile": "/home/jj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jj", "validate_certs": true} 2019-11-25T09:18:10.703 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-25T09:18:10.884 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-11-25T09:18:11.009 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-25T09:18:11.193 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-11-25T09:18:11.329 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-25T09:18:11.550 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-11-25T09:18:11.667 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-25T09:18:11.856 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-11-25T09:18:12.013 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-25T09:18:12.186 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-11-25T09:18:12.355 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-25T09:18:12.524 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-11-25T09:18:12.685 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-25T09:18:12.858 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-25T09:18:13.009 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-25T09:18:13.201 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-11-25T09:18:13.319 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-25T09:18:13.558 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-11-25T09:18:13.674 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-25T09:18:13.893 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAfEhx/xZpJV9ouKFW4QBC46cNicIQMzU8DSYl1GOP9+pnnD+AudVQubvrEePGA7TFkSar5Ccv4dnoQ2s1CaPAtbT+s+nQlf5OFO9P/qvhkM4JhlmH2XxgJAcOvZH2W1HXfGTc4WIuU/OtXM+yWMGlTXxqMqwCvGfqc+Yf8zkt0t3m0kBdWoFcZvdYqKuS15bvdVuiKz7GUxDrtw98yMXb/ob/E+Ygmmphn9dMatTeZ6SD1fbcrHh9oIVbYiY93+++jXzjEXrGzJh/gphgEtvIf8UPMF9HiXXPqwhxneRvghvZ/B05LGfcsqGAtyK09eF94hglyl9kJIdm/d7lmmM/ abhishek.varshney@VS-C02PJ2CSFVH5.local", "key_options": null, "keyfile": "/home/abhishekvrshny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhishekvrshny", "validate_certs": true} 2019-11-25T09:18:14.019 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-25T09:18:14.096 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-25T09:18:14.228 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-11-25T09:18:14.230 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-11-25T09:18:14.353 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-25T09:18:14.354 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-25T09:18:14.556 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-11-25T09:18:14.558 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-11-25T09:18:14.691 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-25T09:18:14.933 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-11-25T09:18:15.006 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-25T09:18:15.267 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUqFGbkDz4L4BpIs2znPSWeawZZM2FBLrR3htaMBM6lcmiX2h+vgVGv2ZLpajGo7KB6J59kzWLBCJXN2DG0uUqa7dOdjEDuDrjZkNgDzXZ20lqzFAjLwNF6a9PcDN/oX6jzK9+3xArleQuTIJsOPRue2dQYGRnyIIrYpapJkkUgI+lXfwrEixCY3xjGNvVoh5bqQmkk3buLIvKEMwhPXJ94SGqsNTNC75HfKhVMjxA8QmuiXJVEgiW00V3Cctwv+yjiDMts4Dcs6yEzxXzjv0c0APxxN78bKlkwFgXiqawLiApk752/x2teSg7kvdrlGcCAWq/BhwphYjwaRlXIj1N shehbaz@donjaffer", "key_options": null, "keyfile": "/home/shehbazj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shehbazj", "validate_certs": true} 2019-11-25T09:18:15.371 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-25T09:18:15.621 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-11-25T09:18:15.714 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-25T09:18:15.953 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJorrIT68EZc7A4IHwQGv8uoblSAIUnMxhOq6rlnvmqx4clpUzKkbzzrZUctP47aeqaSX5Mc6mV8TY0sIH8fFQwahF3ueTKT3YecZvPwiK4ALmawkvFpmgnJKKYhTrEApbFBhtH0KnNLtozpl4RJds4p09maNeoUXJDy3A24tpXViU2Nrw8lSIT6VJzvqSlK+miNEf3VKI6gnRB7fGcJe913zITf09Rew7GexAyQUYHusZbJCf5rl6hkewkZMkgbXfG22f/XWcYjoRtA/ZqeWIP2UDO/H3tfJnlMxUshbDGLllMFJzwmwhkYbapqVmnu7Y01rEQ4LqvaHZMr/yKn+N fche@very.elastic.org", "key_options": null, "keyfile": "/home/fche/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "fche", "validate_certs": true} 2019-11-25T09:18:15.985 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-25T09:18:16.296 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmKchKXS6xKpo+25ZN5vMpbuL4OoFZWPfPSxur6iaBKdr6LSMejnAwkJOhfhH55pZLuAglHWdMcZi8H/ktzsZVd+ybvJNhpZsXdefNqqxUyjn320cT73pDdDC/W1519fUiokss23S6B4GR0B44VrVKezN5Dyhf4sATN8l76QnIALVK5hvYOI3v5k70weaPJM4fma7xYF5b6qSxauGofzMb5XwjNaaPE9F8U08nxGk5XK+S0rHoFnCjoKBlN9Ee1gk6PjsStQAyK5ujWvPGtG/UvuU9LewVbt6wuPbpwsf7Ck0u4wHECHK+185JF/X+qsWwv030pKShXblLVckNVhAx ani@orchid", "key_options": null, "keyfile": "/home/onyb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "onyb", "validate_certs": true} 2019-11-25T09:18:16.319 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-25T09:18:16.628 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-11-25T09:18:16.640 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-25T09:18:16.924 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzf8fjotuelTIdz7clDpSN/VDtXirYrmzM/r157Np9uTMgn/rhzzplp2DKqFrCEDwawJ1O1Fr/H5DqttPonyRmjPmAIf96P8KKLsC600R63xk4DNhnByY0WBU3o1e46LP7DJLsOOy6hZRbyjgoFfzcapH7aV+fa37k7/Ri5mpmdmENa6lYI38+YaItFJf0kTXdFou0iLAt7xogOTimgblMst6UjOhRIsMFA3QS4PvOFR+AedCHeVtYK9mAeRtQ530wKzjz8x4NFU3Y93jmygwTTG2RTEfRjfbObfFOQXJGKcl28pxGPUL9ZlrLx1juAekn2Uz+2oO/eQ8G5w+XW3rp", "key_options": null, "keyfile": "/home/oprypin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oprypin", "validate_certs": true} 2019-11-25T09:18:16.983 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-25T09:18:16.984 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-25T09:18:17.266 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-11-25T09:18:17.267 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-25T09:18:17.319 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-25T09:18:17.327 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-25T09:18:17.332 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-25T09:18:17.599 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-11-25T09:18:17.600 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-11-25T09:18:17.602 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-11-25T09:18:17.696 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-25T09:18:17.948 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-11-25T09:18:18.016 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-25T09:18:18.279 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-11-25T09:18:18.347 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-25T09:18:18.641 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-11-25T09:18:18.700 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-25T09:18:18.703 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-25T09:18:18.989 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDLCJHta/5O2C2MXRegwo+bJUiqbkESr+RwoH/VIdb4L0JDlVsqV+K+BOBjLZy3vwzWCaSackvshoZHAwGvvfGXjtLbhAYs6QWWHODf/XWBvOW4a96fbTToNpV1dXkHAGqlJMYln3GKVD0o9b69iQUTcLILJhWQjCoTjZsvTtP9OYn9YLfuoxhaaU3PazZVhZYml4Ca/3ns9vNQ/m+v4nh82ysyflGKYozEq0pl8VH0Ydy/FtOO98PhQx3crrivu3qghubntVRQnULUmlDSFhMff+ukLVdj2U0AdSBatlJuaSofWUMAQkv0Ia/om9doDGv2TqkXhJnZdGaWJwmuh6rKIZr7d7TYTD6Uag3wJ1NKiDETRNtmMCLuniEJzPO4asBpSSWGyVatyrNmAgBb6XCeZRkRcYvTXdA5OESKG3HJeguk0XCrjosIEYcvxyye9SgA8U73jWdDUdh0yIHLWcfrgC2eynE1uBnTPNBvtnf9pKqMEp5opdRAUhckhPRxJQ2JHcYMAFnq7gz1bL2boL2ElZOqHBx9qgv0ZKnk+YXqhyp2EP2JK0urd0EHMqkGUsRc7D0FSrz+j4lSkd71sHu3tMgwIrgDR55wYMBBRXTrR8pGTMnGldDBaxvUCgWnlsTQJdjs9xCM5gcJzzgZgkRBmrTOUkw2ABre6KMRAmQ4Zg3HxO0MBr5rfV5glWXuDJXsEowLPp/NQ+3X7PIU9LAtKkcZPWC3MayoFdEdNpKieCgOfRAiwJ34fWz4ozM0IvENmUmCKz8+yDAOeupJJ1/367Rl3+U8XTsDNSsqcmsRdr8ZnUIN0662FGr/nHkVaDq79rEywt/V2eMLWyunF0FUUnbwBB8/J0hgIQPX1ncziuzPTF/YCTR6lgVEtvNHPI1xTQsaVQkF9Whu9Eq6Gz1cFq6H/abb1DLJAoO1Cy0HjoT8MjwOICVcsrqxGXsNRBsv4fCxOaz6+WyVWz2O5gpNKOLLmenr9JbiTGjamjfl9dDempRROSDjsJJY6TPdRb0WBuk3i6mOAsAYeBHoargi+a+dQ1IDzGdVY2mUXtDTA6HluZVvzEKnAR6QzuEdRLOrbteETRQ3cV9STXgscCTokzDNzhYbkLUIl/SRBYBdPMiR9TgW+m/0IJkBTEEUuDtYVzyHezV94F17vzpK+xbRdk3/WmWPScPDkc9tDp0AGLdZ/FAkNzGM1VE8G5OJ7OduogIdIQW6yR8y+CP1O4e2WYZ3M0IjJFX8pc/zBinUBNOBvgAzO8aSXTgxXbs/Q1fcv7htmJZ/3nnB4U6N85tq5oklCWulk3tIFI5pMGiQUoQCW8PH2nwasaKKtOInBZMWm8B2K0c5bU2/bKRcXJNJ asheplyakov@as-ubuntu", "key_options": null, "keyfile": "/home/asheplyakov/.ssh/authorized_keys 2019-11-25T09:18:18.991 INFO:teuthology.task.ansible.out:", "manage_dir": true, "path": null, "state": "present", "user": "asheplyakov", "validate_certs": true} 2019-11-25T09:18:19.030 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-25T09:18:19.319 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-11-25T09:18:19.379 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-25T09:18:19.654 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-11-25T09:18:19.716 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-25T09:18:20.011 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-11-25T09:18:20.043 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-25T09:18:20.351 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-11-25T09:18:20.377 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-25T09:18:20.652 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-11-25T09:18:20.705 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-25T09:18:20.976 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCmp/WxBoQxK/3bI3N9X4INmChIFtG/75NULYt9CAAnoOhFHe8xHMOU4x/YS6JdoIBJXusrjbDhCksFSK/caoOow9CQp3VWytslRSjfjkjbwwWHSdcyGpSO4lS5F32SgLOZBuyktpkLDgi6Ou5OTNKokJO8qiZo9Uw0rEBNakfsVi+fpysUDL792Jk1ROUr0HUpwqrQfTPZaue+PomXPQSYIqf06EH1nJYho6D4jt/g6U0qc66WTW5dXTkWD2VVQjZbFGkamz0ICHBJ/Xpf4TjWQVotsYD5NtbvqPo6ygpJYNhKR2n2zA+L4Zu2n0AEib5S4ftNxc7gNDCCfVs/EEIvXp/3CjKVPxHf4xUUPUZj+SQFnSUPQfeY1iIydoX+IG9oj5kKmQBdQFxbAaZJ679bORIqlH73dUFGr2rfS1UlIgPW5ll77bixsB0GP3+Jw4FF5QbO+k1d5qJpUw+8D6FbWAppP7hnSAok9PTpBqfkMpFiX00ZTIFwKCBLxdtJOfbIhbOPCnyEoB2ZLfRiBJmXhBpLjGghWIPPnGZh+yeJiy/EyKwN57vLmjdmvcDgSsjHswT+rQ+QzPoF+/KcdU1LL6ME6i+R7o7aiLOdDpZo4p5d1kr3VMNjVNM+L9ECpTntPhyrglOX018Q8xcNRh2/z+G6NsiiV4t0YxFdk/ICTQ== Jesse.Williamson@suse.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCXsBAd8JfyMT352SjfhZ2Nj3gR2PkeyPS9yB6fKck5CW0Ns1EcUAOIFYw7a1R6zCDJbkkXZDRgM1W6v/UBgpOm69HaNCZuqx19mQRNgo1lhw6hDHc+9754wOmIbgu3gInIS/XPvGzAkGwBW3rWlOaNurY4Y/PH1QyiaujD1Ii9X2Q6yRP8hsDrccual36gngY6wV3G4xKbS8kTY4qQekHkgFT+ZDHv9ibliDfAxtzm5X8N25sICpvcnQkG+Co3QP2XADEhoQrs8L7QekKYPlX8zq6rJBO0cGYW50E58LJk7s67n7QQPCy04xeAf9KOZZBSMHTI8eSFHjb8B034IkHH jwilliamson@linux-z0c6", "key_options": null, "keyfile": "/home/jwilliamson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jwilliamson", "validate_certs": true} 2019-11-25T09:18:21.028 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-25T09:18:21.030 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-25T09:18:21.314 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-11-25T09:18:21.316 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-11-25T09:18:21.367 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-25T09:18:21.645 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-11-25T09:18:21.718 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-25T09:18:21.981 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-11-25T09:18:22.067 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-25T09:18:22.069 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-25T09:18:22.383 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-25T09:18:22.448 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-11-25T09:18:22.450 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-11-25T09:18:22.713 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-25T09:18:22.798 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-11-25T09:18:23.157 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-11-25T09:18:23.200 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-25T09:18:23.496 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDC3aWYoBDxRh13e+qver2xcmCtNsiVEt9NkN1cntdUxVbjfWgb+E/b54kPW456tswoVaYS+3xI5DYTPTN1tMhx8jnrgVKI2HhIYC3SO0+V+HNofzU1p7v5CfZxwyupXOgdfHmEWKOepPop8qWon8wZVUkj2t80w8Ifxh5gLVigGquc4kvMLyy6nBI0k6UGeRr9lSKmWLvzudWP70cWij3ynwxEeIuurU0HI9tDmjaVW5dJuu6IZHDhJrCpeUZBQIDqjH0pg1i1uXXwwiLI9NW8jWuALREDeMxAG4IgOZtoXdS7J9vVXHxKpa8ofb+qYNXI7B3OTLgjSS2ziiU1KEIr wanjun.lp@alibaba-inc.com", "key_options": null, "keyfile": "/home/liupan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liupan", "validate_certs": true} 2019-11-25T09:18:23.569 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-25T09:18:23.837 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-11-25T09:18:23.911 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-25T09:18:24.196 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0PusmXbjqduPTosGmqFsi2cUjRIiWmMnATY/vuawopBxRNykGnyeh1MfVLgkulM6zBJ3cDZxLsZYykpsHGvaXgLL5r6bEOOKPu8sSMwaTfZWNewue6xa1vOYAggeWOt8KTd0IO/pZZfvFcJ80tjtcNvY8zOJ9TO5W7RpglfJhPneC9Kr726yZ4RX3Hqlx+nIMzrSlvZVtwsKikanImvGLDulRiHqgE5BcqGvDF1yCSIq4OYF2i2Sk+dnPnQtN2uePsxPYKikd0B/rua5q+hDDAz2I36NhaUIhLteE6acWJK5Z2s0o1rWAS5XMbF4qYM3nbaE1Au/nXHcjO3sf6mj3 amarangone@macair.local", "key_options": null, "keyfile": "/home/amarangone/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amarangone", "validate_certs": true} 2019-11-25T09:18:24.218 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-25T09:18:24.538 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-11-25T09:18:24.550 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-25T09:18:24.901 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIGGibBaZykvZPLLQm/UIDUlqVxeyJvZEOO+/7pjqX3O47nilNILLnv/oWhQN1S5eGVev9lnTlTxqI0Mt0N/B9vbCxoxx3ujsSgc+FZL58rMBN4uaTvHhYgqOYo3ht6fciRqSvcqeOGNKU8HnXS0/C8bJrYoKUTnmaaZjQ0bSw/AMsAIxu3bZmWT+HfgVaMh9PjPgC+XnDypEcRkOLbeEIs+0s1TgSR7Hs/vEuVtLH3Ph4WZwKVKQhfugmbblLLNvHvTy0q5afdh2RQ9MEaUgxXMgVq4hJ/JcFNZp+ZU5irOPQosZfjSLWJKx/LH+Ye4/8nINi08w0MZgcK79CwukJ kmroz@suse.com", "key_options": null, "keyfile": "/home/kmroz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kmroz", "validate_certs": true} 2019-11-25T09:18:24.902 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-11-25T09:18:25.257 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJ 2019-11-25T09:18:25.259 INFO:teuthology.task.ansible.out:VhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-25T09:18:25.582 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-25T09:18:25.584 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-11-25T09:18:25.904 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-11-25T09:18:25.950 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-25T09:18:26.263 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-11-25T09:18:26.289 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-25T09:18:26.610 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-11-25T09:18:26.611 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-25T09:18:26.957 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-25T09:18:26.980 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-11-25T09:18:27.267 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-25T09:18:27.352 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDf1IrqEe8zPM6DWf8Y+WLRU+TwX8Xzki1CQDRwK/w/F7qxAuh9cbX8tCTkZUt0L3pUjGpM1C3bkTzLHaN4bxK1RQ/klB7C3AXjNOJSPJSjcn/N3YuKU3sKWuQkXnQTwqUdTzHuZ8lQWywFItmwQR2Y6T+xG/Ecig+vdU5lwQ479gtt/lB9buI+T10Lefk2bUiYq1PmKSCIF4KtsIdmSazmIQyvsbsBVblMEezCC0auwo7P7SdfSaobf4x4ZZyJfYkVxiL6eGJ8vmBSbJFrcVMkAO07wBtpn/gQa3Dt4xUdXXt7zBizpMmRPLm8m3Pl2kIJhqrIa1cFXPRr5GJ0YXzR mu3e@Mu3e\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNisR+EK2sG/E9dSeoEYCfgzIunFnuu+SFWGyWR3K6Q5Evt7bVAsGnjglNXdVgLbGV4Il+Z+FFgtR/oJgtUZ7G0IwWKG+nlx06hOu2DObsgM7gcIlhrf7SNsI13Bit0v5dQkyLwcmpdwioQyUx5hnx8UamqVo7lLtKsHS8melz7JE/+dnGwIMJLB1Ot/8PIRAb+/NRXpnD/lje5u8idr43bhreuJ6Lell+h8X2vomuvLlA5XjAoROY6L5qKoM3+bD4QXbU006VHg/7wl9tpZIi9XwAuHfaktsmfks+u3eYFCd9nYUKN20zbEecoAA1rOrCF1qhgwTYpa/Rmh7Iy53p mu3e@thinkpad-t510", "key_options": null, "keyfile": "/home/adamyanova/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adamyanova", "validate_certs": true} 2019-11-25T09:18:27.586 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-25T09:18:27.676 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-11-25T09:18:27.943 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-25T09:18:28.009 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-11-25T09:18:28.303 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-25T09:18:28.329 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-11-25T09:18:28.613 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-25T09:18:28.705 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-11-25T09:18:28.942 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-25T09:18:29.018 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-11-25T09:18:29.288 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-25T09:18:29.366 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-11-25T09:18:29.645 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-25T09:18:29.693 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-11-25T09:18:30.001 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-25T09:18:30.035 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-11-25T09:18:30.285 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-25T09:18:30.362 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-11-25T09:18:30.637 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-25T09:18:30.640 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-11-25T09:18:30.973 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-25T09:18:31.007 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-11-25T09:18:31.311 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-25T09:18:31.349 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-11-25T09:18:31.621 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-25T09:18:31.715 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-11-25T09:18:31.956 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-25T09:18:32.166 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-11-25T09:18:32.302 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-25T09:18:32.304 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-25T09:18:32.573 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-11-25T09:18:32.661 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-25T09:18:32.662 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-25T09:18:32.888 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-11-25T09:18:32.890 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-11-25T09:18:32.983 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-25T09:18:33.272 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-11-25T09:18:33.274 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-11-25T09:18:33.315 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-25T09:18:33.590 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEJa/U9zUfZ7YFl0kwU7Mx3rHPn2O4sdh1J3XBUgoVdrJ4Qnh7i+QhN+fw0eaBWQE2GIsGEX6YWAL5xJ7EuYZyas8OVLNdP9cJIr79M51d8dG/ywqBpgcFnx7qhCSua3sKmP6GCTWGD9Y0eWL2Z6y9t3amb8dPXviMNqKGDz/DaDtp5bPaoG8mDHQ9QeADYYk3tx6V7+phIBXrI2GKt0BBlJeuZysiUI/XWO46JdMyHvCzvzcdquD446aoWS44waDGj501sgnHVQ7gwf4P1+vFOSEHzkWhbenpJmmTA26f4dim+Jo5JpBW/Ma5mMBvORFhH/Kt+S9P9sPCiF1shWc3 d@d", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-11-25T09:18:33.664 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-25T09:18:33.906 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-11-25T09:18:34.042 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-25T09:18:34.241 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-11-25T09:18:34.371 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-25T09:18:34.539 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-11-25T09:18:34.711 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-25T09:18:34.864 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-11-25T09:18:35.062 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-25T09:18:35.178 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-11-25T09:18:35.411 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-25T09:18:35.538 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-11-25T09:18:35.774 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-25T09:18:35.891 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-11-25T09:18:36.108 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-25T09:18:36.244 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-11-25T09:18:36.441 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-25T09:18:36.554 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-11-25T09:18:36.790 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-25T09:18:36.912 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-11-25T09:18:37.116 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-25T09:18:37.244 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-11-25T09:18:37.461 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-25T09:18:37.579 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-11-25T09:18:37.801 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-25T09:18:37.803 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-25T09:18:37.928 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-11-25T09:18:38.156 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-25T09:18:38.250 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-11-25T09:18:38.252 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-11-25T09:18:38.510 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-25T09:18:38.632 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:38 +0000 (0:00:38.396) 0:01:32.516 ******* 2019-11-25T09:18:38.648 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-11-25T09:18:38.691 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:38.702 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:38.714 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:38.715 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:38.726 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:38.738 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:38.750 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:38.929 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-11-25T09:18:39.057 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:39 +0000 (0:00:00.425) 0:01:32.941 ******* 2019-11-25T09:18:39.069 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-11-25T09:18:39.070 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-25T09:18:39.085 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.106 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.107 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.118 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.129 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.151 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.152 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.154 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.164 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.175 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.425 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-25T09:18:39.529 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-11-25T09:18:39.534 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:39.746 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-25T09:18:39.882 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-11-25T09:18:40.094 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-25T09:18:40.200 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9', u'name': u'sbillah', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "name": "sbillah", "ovpn": "sbillah@syed-machine qVcw+LuFQQxYW7QpzZ3aLA d028c4635289a781f3ebe26a545e084572613b03cc9cde7770018ad0259e4dc9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEgeHHS5jx9k7QdOEGqZjaxEAPJ6vv/WZXJNpifBpm9Ba1FRA1U3qHV8oX/bBZ08HIBGg8hQOeZ5I7d5HyzR0971W6KVgDF+s6mRN7d+heNi3XmikbJrozLoEiVQNHIsXjUoc655c2y9NR9Lf5FBweSSrbE34jCUqTA3XmZOdbkjY+ngOcDIfNixRG0yZ57p6UqYW0I+Mg68CB7N+Lv4gFvH/968aML7ConABPGs+vnLdNSQbjuibnaoZwzeSgPoaBJEqBCgNkwO8TyaC04okMj2X7/FGxgZNhwF0V5SVpBllWlGqdAigEF0dher88PbzSIFSm/x8PeACSZWkU0QWV Masum@MASUM-PC", "key_options": null, "keyfile": "/home/sbillah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sbillah", "validate_certs": true} 2019-11-25T09:18:40.399 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-11-25T09:18:40.411 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.424 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.447 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.448 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.468 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.479 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.480 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.495 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.507 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.507 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.518 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.535 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.541 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-11-25T09:18:40.543 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.555 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.565 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.576 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.588 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.600 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.601 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.611 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.631 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.643 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.644 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.656 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.657 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.668 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.679 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.691 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.702 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.703 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.714 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.727 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.732 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.739 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.750 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.751 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.762 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.773 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.785 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.796 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.798 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.808 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.838 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.850 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} ok: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcah 2019-11-25T09:18:40.856 INFO:teuthology.task.ansible.out:j+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.861 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.867 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.873 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.889 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.897 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.914 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.924 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.937 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.939 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.949 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.950 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.961 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.973 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.984 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.985 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:40.996 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.007 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.008 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.009 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.020 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.031 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.031 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.053 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.169 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.171 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n', u'name': u'jj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jj", "ovpn": "jj@aurora PFzIfG7NjrCYxJvxd//soA 395884ddf2caa0043f97e4f98530cc3ad646d6f269802a2b79ca1ea7278ee006\njj@metatron iQogIw/KQtewT7oj9Mkivw 0881e5ceb5897e8a370bacee69ad58eb5098090ea4b0d53972214ea7c751e35a\njj@laptop O1e31whZbQ0S7MUtglCRLg 96e39257989ce36e240b5d368e0308d38009d3d923ec398dc9cc6eba371acaa4\njj@aurora2 EtAvlrozxiL3PLYp6mvATg 1018928736c33ed06246f208cd02aa10c0a6efa5b4e34e32408d7a6c72c32e11\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.180 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.181 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.182 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.184 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.186 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.187 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.189 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.190 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.192 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.193 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.195 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.206 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.207 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.218 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.227 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.230 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9', u'name': u'abhishekvrshny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhishekvrshny", "ovpn": "abhishekvrshny@flipkart QTqbWHaqvXwB+yBy6CVO7A 25d026c49dc49b3a1f445d2dc0099d5ed916645b0adb8d0306269ace7a2096e9"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.231 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.233 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.243 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.244 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.247 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.267 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.268 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246', u'name': u'shehbazj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shehbazj", "ovpn": "shehbazj@smrhost oEliXj/jPmfXv9AUAFKB5A 8bb3a682b4ff15de655c0fe610d350c5805d0a970471e4810b648f47e2811246"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.280 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.280 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.292 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.294 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.304 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3', u'name': u'fche'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "fche", "ovpn": "fche@redhat.com LiziWkWg2uWoEHb3Ln92dQ 9c5497793758b069adbba9284dd55944276ba4dac0bb95d9357c81b58174a3c3"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.306 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4', u'name': u'onyb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "onyb", "ovpn": "ani@orchid AgbLf9Dufuji5r+9WxM69g b73b7eacb9b628387a17cb1e0a84ff19c29d45dca8f0768e407aa599bc6996c4"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.316 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.316 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.318 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.328 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3', u'name': u'oprypin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oprypin", "ovpn": "oprypin@bx-pc-arch 5WYD7PWKwdSQjfGo95ehWw f3c9f170d74c6c443cf0f82f0d87045e1d3a0dbcd01474f6e667ea20a00978b3"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.329 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.330 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.341 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.342 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.344 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.354 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.356 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.367 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.369 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051', u'name': u'asheplyakov'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "asheplyakov", "ovpn": "asheplyakov@asheplyakov.srt.mirantis.net wFW0ZgT4cNhKRAGXiUtevQ 1b11f0702b2db42a42aae6579737ece2caad3b80a8186b971686575cb76b3051"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.379 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.380 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.392 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.392 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.404 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.405 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.406 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.417 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0', u'name': u'jwilliamson'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jwilliamson", "ovpn": "jwilliamson@glaurung +d028NM7xCxkVdxxO+b1Lw fece65125073fdc287af724ee4724ad84d2864e758d50dcb23c07b05c3595fe0"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.418 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.432 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.444 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.456 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.457 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.459 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.459 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.461 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.479 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.480 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77', u'name': u'liupan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liupan", "ovpn": "liupan@ceph-dev-2 9+Is4mIZgNkYyJLwHvSNOA 5a8fafc187d52041daf4365125692d4619fc557b75560913130c0596f83bbb77"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.481 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.526 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:41 +0000 (0:00:02.468) 0:01:35.409 ******* 2019-11-25T09:18:41.533 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6', u'name': u'amarangone'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amarangone", "ovpn": "amarangone@macair.local 9Fslt44BqONCYNhf+uhcnQ 12d46ec6815378a12abc5df00e65235ccbc06ffb0fe5d1db75540a4805cb58b6"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.537 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57', u'name': u'kmroz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kmroz", "ovpn": "kmroz@suse /JbrIs2mKL5exdmcDnhRgg db4d19ab99c7174429d5ae7b6ca3cf4e04e9bf7810e1826d90f4627643628d57"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", " 2019-11-25T09:18:41.541 INFO:teuthology.task.ansible.out:ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.554 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n', u'name': u'adamyanova'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adamyanova", "ovpn": "adamyanova@centos k2nfk8hmGW77nys3R/JkOg 7695b95c2f157d60622e0b0b7ab06fa2cb18661a190d839f7ea587bc44aa0e3c\nadamyanova@ubuntu FmlKgjVzPUxfNDnHeU9vLQ ef7d5524863dfa0787fc5e249873c1a5ea58e7fd5aee27e1d1d33d6f87388a2d\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.601 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:41 +0000 (0:00:00.075) 0:01:35.484 ******* 2019-11-25T09:18:41.606 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.607 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.609 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.610 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.633 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.646 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.657 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.658 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.669 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.670 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.680 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.681 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.692 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.703 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@asus hHsL1xugca0LzY52gKqfqQ 312e0f2680f72d9459c707fcd0ccfb777617f00017f0511839e9b7e3167d590f"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.705 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.715 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.726 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.726 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.746 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.755 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.761 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.778 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.793 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.800 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.807 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.830 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.831 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.886 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:41 +0000 (0:00:00.285) 0:01:35.770 ******* 2019-11-25T09:18:41.912 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-11-25T09:18:41.914 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:41.950 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:41 +0000 (0:00:00.063) 0:01:35.834 ******* 2019-11-25T09:18:41.986 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-11-25T09:18:41.987 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-25T09:18:42.261 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-25T09:18:42.335 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-11-25T09:18:42.596 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-25T09:18:42.650 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-11-25T09:18:42.921 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-25T09:18:42.965 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-11-25T09:18:43.226 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-25T09:18:43.320 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-11-25T09:18:43.538 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-25T09:18:43.664 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-11-25T09:18:43.857 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-25T09:18:43.994 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-11-25T09:18:44.177 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-25T09:18:44.312 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-11-25T09:18:44.504 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-25T09:18:44.629 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-11-25T09:18:44.828 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-25T09:18:44.929 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-11-25T09:18:45.109 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-25T09:18:45.209 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-11-25T09:18:45.426 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-25T09:18:45.518 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-11-25T09:18:45.736 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-25T09:18:45.831 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-11-25T09:18:46.042 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-25T09:18:46.157 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-11-25T09:18:46.377 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-25T09:18:46.482 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-11-25T09:18:46.691 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-25T09:18:46.811 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-11-25T09:18:46.999 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-25T09:18:47.107 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-11-25T09:18:47.336 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-25T09:18:47.409 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-11-25T09:18:47.673 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-25T09:18:47.736 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-11-25T09:18:48.010 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-25T09:18:48.063 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-11-25T09:18:48.322 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-25T09:18:48.408 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-11-25T09:18:48.643 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-25T09:18:48.726 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-11-25T09:18:48.955 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-25T09:18:49.051 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-11-25T09:18:49.270 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-25T09:18:49.392 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-11-25T09:18:49.611 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-25T09:18:49.676 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-11-25T09:18:49.899 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-25T09:18:50.004 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-11-25T09:18:50.226 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-25T09:18:50.342 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-11-25T09:18:50.572 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-25T09:18:50.622 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:50 +0000 (0:00:08.671) 0:01:44.506 ******* 2019-11-25T09:18:50.627 INFO:teuthology.task.ansible.out: 2019-11-25T09:18:50.660 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-11-25T09:18:50.666 INFO:teuthology.task.ansible.out: 2019-11-25T09:18:50.989 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-11-25T09:18:51.031 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:51 +0000 (0:00:00.408) 0:01:44.915 ******* 2019-11-25T09:18:51.678 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-25T09:18:51.679 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574673530.65-54727325234108/source", "state": "file", "uid": 0} 2019-11-25T09:18:51.715 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:51 +0000 (0:00:00.684) 0:01:45.599 ******* 2019-11-25T09:18:51.752 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-25T09:18:51.754 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => { "msg": "Host smithi174.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-25T09:18:51.791 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:51 +0000 (0:00:00.075) 0:01:45.674 ******* 2019-11-25T09:18:51.829 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-25T09:18:51.865 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:51 +0000 (0:00:00.074) 0:01:45.749 ******* 2019-11-25T09:18:51.902 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-25T09:18:51.904 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:51.942 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:51 +0000 (0:00:00.076) 0:01:45.825 ******* 2019-11-25T09:18:52.073 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-11-25T09:18:52.075 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "checksum": "50650ef8f5fa65d26a4b4e7fa94b1571b873d967", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "f08a845f35203e506ea1deb151ba8443", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574673531.06-255644153178476/source", "state": "file", "uid": 0} 2019-11-25T09:18:52.115 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.172) 0:01:45.998 ******* 2019-11-25T09:18:52.141 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-11-25T09:18:52.143 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => { "msg": "Host smithi135.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-11-25T09:18:52.184 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.069) 0:01:46.068 ******* 2019-11-25T09:18:52.234 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-11-25T09:18:52.236 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-11-25T09:18:52.281 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.096) 0:01:46.164 ******* 2019-11-25T09:18:52.317 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-11-25T09:18:52.319 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:52.359 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.078) 0:01:46.242 ******* 2019-11-25T09:18:52.397 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-25T09:18:52.398 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.107918", "end": "2019-11-25 09:18:52.365675", "rc": 0, "start": "2019-11-25 09:18:52.257757", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-25T09:18:52.439 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.080) 0:01:46.323 ******* 2019-11-25T09:18:52.466 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-25T09:18:52.467 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:52.508 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.068) 0:01:46.391 ******* 2019-11-25T09:18:52.536 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-11-25T09:18:52.538 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:52.578 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.070) 0:01:46.462 ******* 2019-11-25T09:18:52.616 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-25T09:18:52.618 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:52.654 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.075) 0:01:46.538 ******* 2019-11-25T09:18:52.681 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-25T09:18:52.683 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:52.724 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.070) 0:01:46.608 ******* 2019-11-25T09:18:52.752 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-25T09:18:52.754 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:52.792 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.067) 0:01:46.676 ******* 2019-11-25T09:18:52.801 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-11-25T09:18:52.801 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.105525", "end": "2019-11-25 09:18:52.761471", "rc": 0, "start": "2019-11-25 09:18:52.655946", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-11-25T09:18:52.852 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.059) 0:01:46.735 ******* 2019-11-25T09:18:52.859 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-11-25T09:18:52.861 INFO:teuthology.task.ansible.out: skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:52.901 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.048) 0:01:46.784 ******* 2019-11-25T09:18:52.906 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-11-25T09:18:52.908 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:52.946 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.045) 0:01:46.830 ******* 2019-11-25T09:18:52.951 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-11-25T09:18:52.952 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:52.954 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:52.992 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:52 +0000 (0:00:00.043) 0:01:46.873 ******* 2019-11-25T09:18:52.994 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.032 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.041) 0:01:46.915 ******* 2019-11-25T09:18:53.037 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-11-25T09:18:53.039 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.076 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.043) 0:01:46.959 ******* 2019-11-25T09:18:53.081 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-11-25T09:18:53.084 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.121 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.044) 0:01:47.004 ******* 2019-11-25T09:18:53.126 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-25T09:18:53.127 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.164 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.043) 0:01:47.047 ******* 2019-11-25T09:18:53.169 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-11-25T09:18:53.171 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.207 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.042) 0:01:47.090 ******* 2019-11-25T09:18:53.212 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-25T09:18:53.213 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:53.248 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.041) 0:01:47.132 ******* 2019-11-25T09:18:53.254 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-11-25T09:18:53.256 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.292 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.043) 0:01:47.176 ******* 2019-11-25T09:18:53.300 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.337 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.044) 0:01:47.220 ******* 2019-11-25T09:18:53.344 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.387 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.050) 0:01:47.271 ******* 2019-11-25T09:18:53.392 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-25T09:18:53.394 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:53.432 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.045) 0:01:47.316 ******* 2019-11-25T09:18:53.437 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi135.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:53.439 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:53.475 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.042) 0:01:47.359 ******* 2019-11-25T09:18:53.484 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.518 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.042) 0:01:47.402 ******* 2019-11-25T09:18:53.525 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.561 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.043) 0:01:47.445 ******* 2019-11-25T09:18:53.573 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.606 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.044) 0:01:47.489 ******* 2019-11-25T09:18:53.611 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-11-25T09:18:53.612 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.650 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.044) 0:01:47.534 ******* 2019-11-25T09:18:53.656 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-25T09:18:53.658 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.704 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.054) 0:01:47.588 ******* 2019-11-25T09:18:53.709 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-11-25T09:18:53.711 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:53.752 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.047) 0:01:47.636 ******* 2019-11-25T09:18:53.758 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-25T09:18:53.759 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.807 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.054) 0:01:47.690 ******* 2019-11-25T09:18:53.817 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-11-25T09:18:53.819 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.856 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.049) 0:01:47.740 ******* 2019-11-25T09:18:53.863 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-25T09:18:53.864 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:53.901 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.045) 0:01:47.785 ******* 2019-11-25T09:18:53.906 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-11-25T09:18:53.907 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:53.947 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.045) 0:01:47.830 ******* 2019-11-25T09:18:53.952 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-25T09:18:53.953 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:53.990 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:53 +0000 (0:00:00.043) 0:01:47.874 ******* 2019-11-25T09:18:53.996 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.039 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.048) 0:01:47.922 ******* 2019-11-25T09:18:54.047 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.084 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.044) 0:01:47.967 ******* 2019-11-25T09:18:54.089 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-11-25T09:18:54.090 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.139 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.055) 0:01:48.022 ******* 2019-11-25T09:18:54.145 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-25T09:18:54.146 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.186 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.047) 0:01:48.070 ******* 2019-11-25T09:18:54.192 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-11-25T09:18:54.193 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.230 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.043) 0:01:48.113 ******* 2019-11-25T09:18:54.240 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.272 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.041) 0:01:48.155 ******* 2019-11-25T09:18:54.278 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-11-25T09:18:54.280 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.318 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.046) 0:01:48.202 ******* 2019-11-25T09:18:54.324 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-25T09:18:54.325 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.363 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.044) 0:01:48.246 ******* 2019-11-25T09:18:54.368 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-11-25T09:18:54.370 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:54.409 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.044) 0:01:48.291 ******* 2019-11-25T09:18:54.419 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.451 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.044) 0:01:48.335 ******* 2019-11-25T09:18:54.457 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-11-25T09:18:54.457 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.497 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.045) 0:01:48.380 ******* 2019-11-25T09:18:54.504 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-25T09:18:54.506 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:54.540 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.043) 0:01:48.424 ******* 2019-11-25T09:18:54.545 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-11-25T09:18:54.545 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.582 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.042) 0:01:48.466 ******* 2019-11-25T09:18:54.587 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-25T09:18:54.625 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.042) 0:01:48.509 ******* 2019-11-25T09:18:54.631 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-11-25T09:18:54.632 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.668 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.043) 0:01:48.552 ******* 2019-11-25T09:18:54.674 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-11-25T09:18:54.676 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.717 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.043) 0:01:48.595 ******* 2019-11-25T09:18:54.747 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.764 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.052) 0:01:48.647 ******* 2019-11-25T09:18:54.791 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-11-25T09:18:54.793 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.828 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.064) 0:01:48.712 ******* 2019-11-25T09:18:54.861 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-11-25T09:18:54.863 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:54.900 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.071) 0:01:48.783 ******* 2019-11-25T09:18:54.927 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-11-25T09:18:54.928 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-25T09:18:54.963 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:54 +0000 (0:00:00.063) 0:01:48.847 ******* 2019-11-25T09:18:54.998 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-11-25T09:18:55.038 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:55 +0000 (0:00:00.074) 0:01:48.921 ******* 2019-11-25T09:18:55.054 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-25T09:18:55.080 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:55 +0000 (0:00:00.043) 0:01:48.964 ******* 2019-11-25T09:18:55.092 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:18:55.125 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:55 +0000 (0:00:00.043) 0:01:49.008 ******* 2019-11-25T09:18:55.492 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi135.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-25T09:18:55.526 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:55 +0000 (0:00:00.401) 0:01:49.409 ******* 2019-11-25T09:18:56.283 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-11-25T09:18:56.284 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-25T09:18:56.615 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-11-25T09:18:57.293 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-25T09:18:57.332 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:57 +0000 (0:00:01.806) 0:01:51.216 ******* 2019-11-25T09:18:57.549 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-11-25T09:18:57.596 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:57 +0000 (0:00:00.263) 0:01:51.479 ******* 2019-11-25T09:18:58.461 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-11-25T09:18:58.463 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574673537.37-103819239817476/source", "state": "file", "uid": 0} 2019-11-25T09:18:58.777 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574673537.64-75044943237987/source", "state": "file", "uid": 0} 2019-11-25T09:18:59.777 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574673538.48-97450925552748/source", "state": "file", "uid": 0} 2019-11-25T09:18:59.824 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:18:59 +0000 (0:00:02.228) 0:01:53.707 ******* 2019-11-25T09:18:59.826 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:00.000 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1574673538.81-189116838000536/source", "state": "file", "uid": 0} 2019-11-25T09:19:00.047 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:00 +0000 (0:00:00.222) 0:01:53.930 ******* 2019-11-25T09:19:00.048 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:00.300 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-25T09:19:00.378 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-11-25T09:19:00.635 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-25T09:19:00.638 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-11-25T09:19:00.677 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:00 +0000 (0:00:00.630) 0:01:54.561 ******* 2019-11-25T09:19:00.712 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-25T09:19:00.758 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:00 +0000 (0:00:00.080) 0:01:54.642 ******* 2019-11-25T09:19:12.200 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-25T09:19:12.201 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:11.115804", "end": "2019-11-25 09:19:12.165872", "rc": 0, "start": "2019-11-25 09:19:01.050068", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: packages.oit.ncsu.edu\n * extras: mirror.jaleco.com\n * updates: mirror.trouble-free.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: packages.oit.ncsu.edu", " * extras: mirror.jaleco.com", " * updates: mirror.trouble-free.net", "Metadata Cache Created"]} 2019-11-25T09:19:12.238 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:12 +0000 (0:00:11.479) 0:02:06.121 ******* 2019-11-25T09:19:12.588 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-25T09:19:12.590 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-25T09:19:12.747 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-11-25T09:19:12.747 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:11.736906", "end": "2019-11-25 09:19:12.718961", "rc": 0, "start": "2019-11-25 09:19:00.982055", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: packages.oit.ncsu.edu\n * extras: mirror.jaleco.com\n * updates: mirror.trouble-free.net\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: packages.oit.ncsu.edu", " * extras: mirror.jaleco.com", " * updates: mirror.trouble-free.net", "Metadata Cache Created"]} 2019-11-25T09:19:12.827 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:12 +0000 (0:00:00.588) 0:02:06.710 ******* 2019-11-25T09:19:12.928 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-25T09:19:12.928 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-25T09:19:12.975 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:12 +0000 (0:00:00.141) 0:02:06.852 ******* 2019-11-25T09:19:12.995 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-25T09:19:12.997 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.036 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.067) 0:02:06.920 ******* 2019-11-25T09:19:13.063 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-11-25T09:19:13.065 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.101 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.065) 0:02:06.985 ******* 2019-11-25T09:19:13.129 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-25T09:19:13.130 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.180 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.078) 0:02:07.064 ******* 2019-11-25T09:19:13.186 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-25T09:19:13.187 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-11-25T09:19:13.209 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-25T09:19:13.211 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.254 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.073) 0:02:07.137 ******* 2019-11-25T09:19:13.280 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-11-25T09:19:13.282 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.324 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.070) 0:02:07.207 ******* 2019-11-25T09:19:13.350 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-11-25T09:19:13.352 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.390 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.066) 0:02:07.273 ******* 2019-11-25T09:19:13.416 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-11-25T09:19:13.418 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.458 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.068) 0:02:07.342 ******* 2019-11-25T09:19:13.485 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-11-25T09:19:13.485 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-11-25T09:19:13.488 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-11-25T09:19:13.489 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.541 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.082) 0:02:07.424 ******* 2019-11-25T09:19:13.575 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.033) 0:02:07.458 ******* 2019-11-25T09:19:13.600 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-11-25T09:19:13.602 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.666 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.089) 0:02:07.548 ******* 2019-11-25T09:19:13.696 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.735 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.069) 0:02:07.618 ******* 2019-11-25T09:19:13.761 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-11-25T09:19:13.763 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.804 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.066) 0:02:07.684 ******* 2019-11-25T09:19:13.827 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.880 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.079) 0:02:07.764 ******* 2019-11-25T09:19:13.885 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:13.907 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:13.908 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone] *********************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:13.954 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:13 +0000 (0:00:00.074) 0:02:07.838 ******* 2019-11-25T09:19:13.958 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:13.981 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:13.986 INFO:teuthology.task.ansible.out:TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:14.029 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:14 +0000 (0:00:00.074) 0:02:07.913 ******* 2019-11-25T09:19:14.034 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:14.057 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:14.099 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:14 +0000 (0:00:00.069) 0:02:07.982 ******* 2019-11-25T09:19:14.136 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:14.138 INFO:teuthology.task.ansible.out:TASK [common : Refresh repos] ************************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:14.175 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:14 +0000 (0:00:00.076) 0:02:08.059 ******* 2019-11-25T09:19:14.177 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:15.540 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-11-25T09:19:15.543 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.028865", "end": "2019-11-25 09:19:15.500485", "rc": 0, "start": "2019-11-25 09:19:14.471620", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.674012", "end": "2019-11-25 09:19:15.500449", "rc": 0, "start": "2019-11-25 09:19:13.826437", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:19:15.583 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:15 +0000 (0:00:01.408) 0:02:09.467 ******* 2019-11-25T09:19:15.619 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:15 +0000 (0:00:00.035) 0:02:09.503 ******* 2019-11-25T09:19:16.308 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-25T09:19:16.347 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:16 +0000 (0:00:00.727) 0:02:10.230 ******* 2019-11-25T09:19:16.354 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-11-25T09:19:16.392 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:16 +0000 (0:00:00.045) 0:02:10.275 ******* 2019-11-25T09:19:16.398 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-11-25T09:19:16.400 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:16.436 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:16 +0000 (0:00:00.044) 0:02:10.320 ******* 2019-11-25T09:19:16.442 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:16.481 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:16 +0000 (0:00:00.044) 0:02:10.365 ******* 2019-11-25T09:19:16.487 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-11-25T09:19:16.489 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:16.525 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:16 +0000 (0:00:00.044) 0:02:10.409 ******* 2019-11-25T09:19:16.531 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:16.571 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:16 +0000 (0:00:00.046) 0:02:10.455 ******* 2019-11-25T09:19:16.580 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-11-25T09:19:16.582 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:16.617 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:16 +0000 (0:00:00.045) 0:02:10.500 ******* 2019-11-25T09:19:16.623 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:16.661 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:16 +0000 (0:00:00.043) 0:02:10.544 ******* 2019-11-25T09:19:16.667 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-11-25T09:19:16.668 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:16.706 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:16 +0000 (0:00:00.045) 0:02:10.590 ******* 2019-11-25T09:19:16.712 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:16.751 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:16 +0000 (0:00:00.044) 0:02:10.635 ******* 2019-11-25T09:19:17.657 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-25T09:19:17.704 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:17 +0000 (0:00:00.953) 0:02:11.588 ******* 2019-11-25T09:19:17.706 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:17.714 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-11-25T09:19:17.715 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:17.774 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:17 +0000 (0:00:00.069) 0:02:11.657 ******* 2019-11-25T09:19:17.774 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:21.487 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-11-25T09:19:21.489 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-25T09:19:21.525 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:21 +0000 (0:00:03.751) 0:02:15.409 ******* 2019-11-25T09:19:21.753 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-11-25T09:19:21.800 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:21 +0000 (0:00:00.274) 0:02:15.683 ******* 2019-11-25T09:19:22.460 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-11-25T09:19:22.462 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-25T09:19:22.704 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-11-25T09:19:23.351 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-25T09:19:23.585 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-11-25T09:19:24.205 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-25T09:19:24.246 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:24 +0000 (0:00:02.445) 0:02:18.129 ******* 2019-11-25T09:19:24.498 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-11-25T09:19:24.566 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:24 +0000 (0:00:00.320) 0:02:18.450 ******* 2019-11-25T09:19:24.574 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-11-25T09:19:24.575 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-25T09:19:24.624 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:24 +0000 (0:00:00.057) 0:02:18.508 ******* 2019-11-25T09:19:24.626 INFO:teuthology.task.ansible.out: 2019-11-25T09:19:24.920 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-25T09:19:24.976 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:24 +0000 (0:00:00.346) 0:02:18.854 ******* 2019-11-25T09:19:25.580 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-11-25T09:19:25.581 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-25T09:19:25.926 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-11-25T09:19:26.504 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-25T09:19:26.792 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-11-25T09:19:27.439 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-25T09:19:27.484 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:27 +0000 (0:00:02.513) 0:02:21.368 ******* 2019-11-25T09:19:27.511 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-25T09:19:27.513 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:27.552 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:27 +0000 (0:00:00.067) 0:02:21.436 ******* 2019-11-25T09:19:27.595 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-25T09:19:27.628 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:27 +0000 (0:00:00.075) 0:02:21.511 ******* 2019-11-25T09:19:27.677 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi135.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-11-25T09:19:27.719 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:27 +0000 (0:00:00.091) 0:02:21.603 ******* 2019-11-25T09:19:27.747 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-11-25T09:19:27.748 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:27.797 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:27 +0000 (0:00:00.077) 0:02:21.680 ******* 2019-11-25T09:19:27.835 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-11-25T09:19:27.836 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-11-25T09:19:27.894 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:27 +0000 (0:00:00.097) 0:02:21.778 ******* 2019-11-25T09:19:28.226 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-25T09:19:28.228 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-25T09:19:28.266 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:28 +0000 (0:00:00.371) 0:02:22.150 ******* 2019-11-25T09:19:28.314 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-25T09:19:28.315 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-25T09:19:28.326 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-25T09:19:28.347 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-25T09:19:28.358 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-25T09:19:28.419 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:28 +0000 (0:00:00.152) 0:02:22.303 ******* 2019-11-25T09:19:28.966 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-11-25T09:19:28.968 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-11-25T09:19:29.012 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:29 +0000 (0:00:00.592) 0:02:22.895 ******* 2019-11-25T09:19:29.071 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-11-25T09:19:29.073 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-25T09:19:29.083 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-25T09:19:29.105 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-25T09:19:29.117 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-11-25T09:19:29.160 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:29 +0000 (0:00:00.147) 0:02:23.043 ******* 2019-11-25T09:19:31.836 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-11-25T09:19:31.837 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-25T09:19:31.881 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:31 +0000 (0:00:02.721) 0:02:25.765 ******* 2019-11-25T09:19:31.923 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:31.993 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:31 +0000 (0:00:00.112) 0:02:25.877 ******* 2019-11-25T09:19:32.564 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-11-25T09:19:32.611 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:32 +0000 (0:00:00.617) 0:02:26.495 ******* 2019-11-25T09:19:32.649 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-11-25T09:19:32.651 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:32.699 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:32 +0000 (0:00:00.087) 0:02:26.582 ******* 2019-11-25T09:19:32.907 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-11-25T09:19:32.909 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-25T09:19:32.974 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:32 +0000 (0:00:00.275) 0:02:26.858 ******* 2019-11-25T09:19:33.543 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-11-25T09:19:33.610 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:33 +0000 (0:00:00.635) 0:02:27.494 ******* 2019-11-25T09:19:33.919 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-11-25T09:19:33.921 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-25T09:19:33.965 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:33 +0000 (0:00:00.354) 0:02:27.848 ******* 2019-11-25T09:19:33.993 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-25T09:19:33.995 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:34.038 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:34 +0000 (0:00:00.068) 0:02:27.917 ******* 2019-11-25T09:19:34.334 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi135.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-25T09:19:34.383 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:34 +0000 (0:00:00.350) 0:02:28.267 ******* 2019-11-25T09:19:34.552 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-11-25T09:19:34.605 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:34 +0000 (0:00:00.215) 0:02:28.483 ******* 2019-11-25T09:19:34.632 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-11-25T09:19:34.634 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:34.683 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:34 +0000 (0:00:00.082) 0:02:28.566 ******* 2019-11-25T09:19:34.774 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-25T09:19:34.776 INFO:teuthology.task.ansible.out:fatal: [smithi135.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-25T09:19:34.840 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:34 +0000 (0:00:00.156) 0:02:28.722 ******* 2019-11-25T09:19:34.888 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:34.929 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:34 +0000 (0:00:00.090) 0:02:28.812 ******* 2019-11-25T09:19:35.021 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-11-25T09:19:35.023 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-25T09:19:35.065 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:35 +0000 (0:00:00.135) 0:02:28.947 ******* 2019-11-25T09:19:35.421 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-11-25T09:19:35.422 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-11-25T09:19:35.459 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:35 +0000 (0:00:00.395) 0:02:29.343 ******* 2019-11-25T09:19:35.496 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-11-25T09:19:35.498 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:19:35.536 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:35 +0000 (0:00:00.076) 0:02:29.420 ******* 2019-11-25T09:19:35.884 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-11-25T09:19:35.884 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-25T09:19:35.938 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:35 +0000 (0:00:00.402) 0:02:29.822 ******* 2019-11-25T09:19:36.522 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-11-25T09:19:36.577 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:36 +0000 (0:00:00.638) 0:02:30.461 ******* 2019-11-25T09:19:36.980 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-11-25 09:16:51 UTC", "ActiveEnterTimestampMonotonic": "20104691", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target var-run.mount nss-lookup.target network.target system.slice systemd-journald.socket time-sync.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-11-25 09:16:51 UTC", "AssertTimestampMonotonic": "20104113", "Before": "getty@tty1.service shutdown.target multi-user.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-11-25 09:16:51 UTC", "ConditionTimestampMonotonic": "20104111", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8938", "ExecMainStartTimestamp": "Mon 2019-11-25 09:16:51 UTC", "ExecMainStartTimestampMonotonic": "20104643", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbi 2019-11-25T09:19:36.982 INFO:teuthology.task.ansible.out:n/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Mon 2019-11-25 09:16:51 UTC] ; stop_time=[n/a] ; pid=8938 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-11-25 09:16:51 UTC", "InactiveExitTimestampMonotonic": "20104691", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8938", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "network-online.target basic.target", 2019-11-25T09:19:36.984 INFO:teuthology.task.ansible.out: "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Mon 2019-11-25 09:16:51 UTC", "WatchdogTimestampMonotonic": "20104674", "WatchdogUSec": "0"}} 2019-11-25T09:19:37.036 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:37 +0000 (0:00:00.446) 0:02:30.908 ******* ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-11-25 09:16:51 UTC", "ActiveEnterTimestampMonotonic": "19563447", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target time-sync.target network.target var-run.mount system.slice basic.target nss-lookup.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-11-25 09:16:51 UTC", "AssertTimestampMonotonic": "19562858", "Before": "xdm.service shutdown.target getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-11-25 09:16:51 UTC", "ConditionTimestampMonotonic": "19562858", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8937", "ExecMainStartTimestamp": "Mon 2019-11-25 09:16:51 UTC", "ExecMainStartTimestampMonotonic": "19563398", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/ 2019-11-25T09:19:37.039 INFO:teuthology.task.ansible.out:nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Mon 2019-11-25 09:16:51 UTC] ; stop_time=[n/a] ; pid=8937 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-11-25 09:16:51 UTC", "InactiveExitTimestampMonotonic": "19563447", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8937", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", " 2019-11-25T09:19:37.041 INFO:teuthology.task.ansible.out:Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Mon 2019-11-25 09:16:51 UTC", "WatchdogTimestampMonotonic": "19563430", "WatchdogUSec": "0"}} 2019-11-25T09:19:37.080 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:37 +0000 (0:00:00.055) 0:02:30.963 ******* 2019-11-25T09:19:37.327 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004826", "end": "2019-11-25 09:19:37.299726", "rc": 0, "start": "2019-11-25 09:19:37.294900", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-25T09:19:37.377 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:37 +0000 (0:00:00.293) 0:02:31.257 ******* 2019-11-25T09:19:37.417 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.004323", "end": "2019-11-25 09:19:37.383205", "rc": 0, "start": "2019-11-25 09:19:37.378882", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-11-25T09:19:37.456 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:37 +0000 (0:00:00.082) 0:02:31.340 ******* 2019-11-25T09:19:37.855 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-11-25T09:19:37.855 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-25T09:19:37.892 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:37 +0000 (0:00:00.436) 0:02:31.776 ******* 2019-11-25T09:19:37.930 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-11-25T09:19:37.994 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:37 +0000 (0:00:00.101) 0:02:31.878 ******* 2019-11-25T09:19:40.328 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-11-25T09:19:40.329 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-25T09:19:40.383 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:40 +0000 (0:00:02.388) 0:02:34.267 ******* 2019-11-25T09:19:40.452 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing selinux-policy-targeted are up to date", ""]} 2019-11-25T09:19:40.494 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:40 +0000 (0:00:00.109) 0:02:34.376 ******* 2019-11-25T09:19:43.155 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-11-25T09:19:43.157 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-25T09:19:43.191 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:43 +0000 (0:00:02.698) 0:02:37.075 ******* 2019-11-25T09:19:43.360 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-11-25T09:19:43.395 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:43 +0000 (0:00:00.204) 0:02:37.279 ******* 2019-11-25T09:19:51.681 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.170245", "end": "2019-11-25 09:19:51.642315", "failed_when_result": false, "rc": 0, "start": "2019-11-25 09:19:43.472070", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-25T09:19:51.718 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:51 +0000 (0:00:08.322) 0:02:45.602 ******* 2019-11-25T09:19:51.736 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.949105", "end": "2019-11-25 09:19:51.659382", "failed_when_result": false, "rc": 0, "start": "2019-11-25 09:19:43.710277", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-11-25T09:19:51.765 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:51 +0000 (0:00:00.046) 0:02:45.648 ******* 2019-11-25T09:19:52.706 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-11-25T09:19:52.707 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-25T09:19:52.749 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:52 +0000 (0:00:00.983) 0:02:46.632 ******* 2019-11-25T09:19:52.766 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-11-25T09:19:52.809 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:52 +0000 (0:00:00.060) 0:02:46.693 ******* 2019-11-25T09:19:53.106 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-11-25T09:19:53.107 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.019162", "end": "2019-11-25 09:19:53.080666", "rc": 0, "start": "2019-11-25 09:19:53.061504", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-25T09:19:53.157 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:53 +0000 (0:00:00.345) 0:02:47.038 ******* 2019-11-25T09:19:53.162 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.017036", "end": "2019-11-25 09:19:53.129178", "rc": 0, "start": "2019-11-25 09:19:53.112142", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-11-25T09:19:53.209 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:53 +0000 (0:00:00.054) 0:02:47.092 ******* 2019-11-25T09:19:53.466 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-11-25T09:19:53.467 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.016990", "end": "2019-11-25 09:19:53.438841", "rc": 0, "start": "2019-11-25 09:19:53.421851", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:19:53.508 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:53 +0000 (0:00:00.300) 0:02:47.392 ******* 2019-11-25T09:19:53.569 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.038572", "end": "2019-11-25 09:19:53.533445", "rc": 0, "start": "2019-11-25 09:19:53.494873", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:19:53.606 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:19:53 +0000 (0:00:00.098) 0:02:47.490 ******* 2019-11-25T09:20:01.552 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-11-25T09:20:01.553 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.720340", "end": "2019-11-25 09:20:01.520107", "rc": 0, "start": "2019-11-25 09:19:53.799767", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:20:01.590 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:01 +0000 (0:00:07.983) 0:02:55.474 ******* 2019-11-25T09:20:01.828 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.884391", "end": "2019-11-25 09:20:01.786309", "rc": 0, "start": "2019-11-25 09:19:53.901918", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:20:01.876 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:01 +0000 (0:00:00.285) 0:02:55.759 ******* 2019-11-25T09:20:01.903 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-11-25T09:20:01.905 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-25T09:20:01.951 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:01 +0000 (0:00:00.073) 0:02:55.833 ******* 2019-11-25T09:20:01.987 INFO:teuthology.task.ansible.out: 2019-11-25T09:20:01.988 INFO:teuthology.task.ansible.out:TASK [testnode : Include package type specific vars.] ************************** 2019-11-25T09:20:01.989 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-25T09:20:02.032 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.083) 0:02:55.916 ******* 2019-11-25T09:20:02.069 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-25T09:20:02.071 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-25T09:20:02.113 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.080) 0:02:55.996 ******* 2019-11-25T09:20:02.116 INFO:teuthology.task.ansible.out: 2019-11-25T09:20:02.151 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-11-25T09:20:02.152 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-25T09:20:02.192 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.078) 0:02:56.075 ******* 2019-11-25T09:20:02.239 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-25T09:20:02.240 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-11-25T09:20:02.278 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.086) 0:02:56.161 ******* 2019-11-25T09:20:02.312 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.033) 0:02:56.195 ******* 2019-11-25T09:20:02.322 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi135.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-11-25T09:20:02.356 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.044) 0:02:56.240 ******* 2019-11-25T09:20:02.393 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-11-25T09:20:02.395 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-25T09:20:02.430 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.073) 0:02:56.314 ******* 2019-11-25T09:20:02.480 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi135.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-11-25T09:20:02.516 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.085) 0:02:56.399 ******* 2019-11-25T09:20:02.563 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-11-25T09:20:02.564 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-11-25T09:20:02.601 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.085) 0:02:56.485 ******* 2019-11-25T09:20:02.608 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-25T09:20:02.646 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.044) 0:02:56.529 ******* 2019-11-25T09:20:02.933 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-11-25T09:20:02.970 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:02 +0000 (0:00:00.324) 0:02:56.854 ******* 2019-11-25T09:20:02.987 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-25T09:20:02.988 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-25T09:20:03.031 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:03 +0000 (0:00:00.060) 0:02:56.914 ******* 2019-11-25T09:20:03.057 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-25T09:20:03.058 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:03.095 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:03 +0000 (0:00:00.064) 0:02:56.979 ******* 2019-11-25T09:20:03.123 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-25T09:20:03.125 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:03.162 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:03 +0000 (0:00:00.066) 0:02:57.046 ******* 2019-11-25T09:20:03.298 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-11-25T09:20:03.299 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-11-25T09:20:03.339 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:03 +0000 (0:00:00.176) 0:02:57.223 ******* 2019-11-25T09:20:03.376 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-11-25T09:20:03.378 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:03.415 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:03 +0000 (0:00:00.075) 0:02:57.298 ******* 2019-11-25T09:20:03.442 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-11-25T09:20:03.443 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:03.504 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:03 +0000 (0:00:00.089) 0:02:57.387 ******* 2019-11-25T09:20:03.540 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-11-25T09:20:03.541 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-25T09:20:03.581 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:03 +0000 (0:00:00.076) 0:02:57.464 ******* 2019-11-25T09:20:03.871 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-11-25T09:20:03.913 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:03 +0000 (0:00:00.332) 0:02:57.796 ******* 2019-11-25T09:20:04.623 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-25T09:20:04.625 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-25T09:20:04.670 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:04 +0000 (0:00:00.757) 0:02:58.554 ******* 2019-11-25T09:20:04.707 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-11-25T09:20:04.709 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi174"}, "changed": false} 2019-11-25T09:20:04.748 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:04 +0000 (0:00:00.077) 0:02:58.631 ******* 2019-11-25T09:20:04.914 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-11-25T09:20:04.915 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-11-25T09:20:04.982 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:04 +0000 (0:00:00.225) 0:02:58.857 ******* 2019-11-25T09:20:05.026 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi135.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi135"}, "changed": false} 2019-11-25T09:20:05.061 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:05 +0000 (0:00:00.087) 0:02:58.945 ******* 2019-11-25T09:20:05.728 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi174.front.sepia.ceph.com", "ansible_hostname": "smithi174", "ansible_nodename": "smithi174"}, "changed": true, "name": "smithi174"} 2019-11-25T09:20:05.729 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi135.front.sepia.ceph.com", "ansible_hostname": "smithi135", "ansible_nodename": "smithi135"}, "changed": true, "name": "smithi135"} 2019-11-25T09:20:05.775 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:05 +0000 (0:00:00.714) 0:02:59.659 ******* 2019-11-25T09:20:05.813 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:05 +0000 (0:00:00.037) 0:02:59.697 ******* 2019-11-25T09:20:06.620 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-25T09:20:06.654 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:06 +0000 (0:00:00.841) 0:03:00.538 ******* 2019-11-25T09:20:06.714 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-11-25T09:20:06.753 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:06 +0000 (0:00:00.098) 0:03:00.636 ******* 2019-11-25T09:20:07.549 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-11-25T09:20:07.550 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-25T09:20:07.608 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:07 +0000 (0:00:00.855) 0:03:01.492 ******* 2019-11-25T09:20:07.703 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-11-25T09:20:07.744 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:07 +0000 (0:00:00.135) 0:03:01.628 ******* 2019-11-25T09:20:08.439 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-11-25T09:20:08.441 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-25T09:20:08.479 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:08 +0000 (0:00:00.735) 0:03:02.363 ******* 2019-11-25T09:20:08.623 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-11-25T09:20:08.662 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:08 +0000 (0:00:00.182) 0:03:02.546 ******* 2019-11-25T09:20:09.332 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-11-25T09:20:09.333 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-25T09:20:09.384 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:09 +0000 (0:00:00.722) 0:03:03.268 ******* 2019-11-25T09:20:09.574 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-11-25T09:20:09.628 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:09 +0000 (0:00:00.237) 0:03:03.505 ******* 2019-11-25T09:20:09.702 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-25T09:20:09.703 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-25T09:20:09.768 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:09 +0000 (0:00:00.146) 0:03:03.651 ******* 2019-11-25T09:20:09.962 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-25T09:20:10.019 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:10 +0000 (0:00:00.246) 0:03:03.898 ******* 2019-11-25T09:20:10.093 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-25T09:20:10.134 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:10 +0000 (0:00:00.120) 0:03:04.018 ******* 2019-11-25T09:20:10.353 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-11-25T09:20:10.390 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:10 +0000 (0:00:00.255) 0:03:04.273 ******* 2019-11-25T09:20:10.506 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-25T09:20:10.507 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-25T09:20:10.549 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:10 +0000 (0:00:00.159) 0:03:04.433 ******* 2019-11-25T09:20:10.789 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-11-25T09:20:10.839 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:10 +0000 (0:00:00.289) 0:03:04.722 ******* 2019-11-25T09:20:11.498 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-25T09:20:11.500 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-25T09:20:11.542 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:11 +0000 (0:00:00.703) 0:03:05.425 ******* 2019-11-25T09:20:11.801 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-11-25T09:20:11.862 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:11 +0000 (0:00:00.320) 0:03:05.746 ******* 2019-11-25T09:20:12.496 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-11-25T09:20:12.500 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-25T09:20:12.543 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:12 +0000 (0:00:00.680) 0:03:06.427 ******* 2019-11-25T09:20:12.813 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-11-25T09:20:12.871 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:12 +0000 (0:00:00.327) 0:03:06.754 ******* 2019-11-25T09:20:15.024 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-25T09:20:15.025 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-11-25T09:20:15.026 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.144437", "end": "2019-11-25 09:20:14.990998", "rc": 0, "start": "2019-11-25 09:20:12.846561", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:20:15.073 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:15 +0000 (0:00:02.201) 0:03:08.956 ******* 2019-11-25T09:20:15.104 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-25T09:20:15.163 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:15 +0000 (0:00:00.090) 0:03:09.047 ******* 2019-11-25T09:20:15.280 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-25T09:20:15.282 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.072752", "end": "2019-11-25 09:20:15.240519", "rc": 0, "start": "2019-11-25 09:20:13.167767", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:20:15.329 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:15 +0000 (0:00:00.166) 0:03:09.213 ******* 2019-11-25T09:20:15.356 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-11-25T09:20:15.392 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:15 +0000 (0:00:00.062) 0:03:09.275 ******* 2019-11-25T09:20:16.120 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-25T09:20:16.121 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-25T09:20:16.370 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-11-25T09:20:17.007 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-25T09:20:17.067 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:01.674) 0:03:10.950 ******* 2019-11-25T09:20:17.094 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-25T09:20:17.096 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:17.143 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:00.076) 0:03:11.026 ******* 2019-11-25T09:20:17.190 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-25T09:20:17.210 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-25T09:20:17.234 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:00.091) 0:03:11.118 ******* 2019-11-25T09:20:17.264 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-25T09:20:17.266 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:17.302 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:00.067) 0:03:11.185 ******* 2019-11-25T09:20:17.308 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-11-25T09:20:17.309 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-11-25T09:20:17.354 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:00.051) 0:03:11.237 ******* 2019-11-25T09:20:17.359 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-25T09:20:17.361 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-25T09:20:17.398 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:00.044) 0:03:11.282 ******* 2019-11-25T09:20:17.405 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-11-25T09:20:17.406 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:17.448 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:00.049) 0:03:11.331 ******* 2019-11-25T09:20:17.485 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-11-25T09:20:17.489 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-25T09:20:17.497 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-25T09:20:17.536 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:00.088) 0:03:11.419 ******* 2019-11-25T09:20:17.570 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-11-25T09:20:17.572 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:17.610 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:00.074) 0:03:11.493 ******* 2019-11-25T09:20:17.646 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-25T09:20:17.648 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-11-25T09:20:17.684 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:00.074) 0:03:11.568 ******* 2019-11-25T09:20:17.835 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-11-25T09:20:17.836 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-25T09:20:17.908 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:17 +0000 (0:00:00.219) 0:03:11.787 ******* 2019-11-25T09:20:18.184 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-11-25T09:20:18.226 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:18 +0000 (0:00:00.321) 0:03:12.109 ******* 2019-11-25T09:20:18.228 INFO:teuthology.task.ansible.out: 2019-11-25T09:20:18.561 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.333235", "end": "2019-11-25 09:20:18.521076", "rc": 0, "start": "2019-11-25 09:20:18.187841", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: packages.oit.ncsu.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.jaleco.com\n * updates: mirror.trouble-free.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: packages.oit.ncsu.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.jaleco.com", " * updates: mirror.trouble-free.net", "No unfinished transactions left."]} 2019-11-25T09:20:18.604 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:18 +0000 (0:00:00.373) 0:03:12.483 ******* 2019-11-25T09:20:18.876 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.294476", "end": "2019-11-25 09:20:18.842498", "rc": 0, "start": "2019-11-25 09:20:18.548022", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: packages.oit.ncsu.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.jaleco.com\n * updates: mirror.trouble-free.net\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: packages.oit.ncsu.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.jaleco.com", " * updates: mirror.trouble-free.net", "No unfinished transactions left."]} 2019-11-25T09:20:18.924 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:18 +0000 (0:00:00.322) 0:03:12.805 ******* 2019-11-25T09:20:18.957 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi135.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.038787", "end": "2019-11-25 09:20:18.928575", "msg": "non-zero return code", "rc": 1, "start": "2019-11-25 09:20:18.889788", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-25T09:20:18.993 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:18 +0000 (0:00:00.071) 0:03:12.876 ******* 2019-11-25T09:20:19.020 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-25T09:20:19.023 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:19.062 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:19 +0000 (0:00:00.069) 0:03:12.945 ******* 2019-11-25T09:20:19.316 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-11-25T09:20:19.317 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.056962", "end": "2019-11-25 09:20:19.289930", "msg": "non-zero return code", "rc": 1, "start": "2019-11-25 09:20:19.232968", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-11-25T09:20:19.366 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:19 +0000 (0:00:00.296) 0:03:13.242 ******* 2019-11-25T09:20:19.395 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-11-25T09:20:19.397 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:19.436 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:19 +0000 (0:00:00.078) 0:03:13.320 ******* 2019-11-25T09:20:29.898 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-25T09:20:29.899 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-25T09:20:29.900 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-25T09:20:29.903 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-25T09:20:29.964 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:29 +0000 (0:00:10.527) 0:03:23.847 ******* 2019-11-25T09:20:29.988 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-11-25T09:20:29.989 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-11-25T09:20:29.991 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-25T09:20:30.042 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:30 +0000 (0:00:00.078) 0:03:23.926 ******* 2019-11-25T09:20:33.459 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-11-25T09:20:33.459 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-25T09:20:33.500 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:33 +0000 (0:00:03.457) 0:03:27.383 ******* 2019-11-25T09:20:33.507 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-11-25T09:20:33.548 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:33 +0000 (0:00:00.048) 0:03:27.432 ******* 2019-11-25T09:20:54.459 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-25T09:20:54.461 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-25T09:20:54.462 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-25T09:20:54.464 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: packages.oit.ncsu.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.jaleco.com\n * updates: mirror.trouble-free.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Reso 2019-11-25T09:20:54.466 INFO:teuthology.task.ansible.out:lved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 2.5 MB/s | 8.1 MB 00:03 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-11-25T09:20:54.467 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-25T09:20:54.510 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:54 +0000 (0:00:20.962) 0:03:48.394 ******* 2019-11-25T09:20:54.740 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-11-25T09:20:54.742 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-11-25T09:20:54.744 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: packages.oit.ncsu.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.jaleco.com\n * updates: mirror.trouble-free.net\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Reso 2019-11-25T09:20:54.746 INFO:teuthology.task.ansible.out:lved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 2.5 MB/s | 8.1 MB 00:03 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-11-25T09:20:54.747 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-11-25T09:20:54.778 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:54 +0000 (0:00:00.267) 0:03:48.661 ******* 2019-11-25T09:20:55.292 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-25T09:20:55.322 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:55 +0000 (0:00:00.544) 0:03:49.205 ******* 2019-11-25T09:20:55.558 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-11-25T09:20:55.598 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:55 +0000 (0:00:00.275) 0:03:49.481 ******* 2019-11-25T09:20:55.853 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-25T09:20:55.898 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:55 +0000 (0:00:00.300) 0:03:49.782 ******* 2019-11-25T09:20:55.926 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-25T09:20:55.928 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:55.967 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:55 +0000 (0:00:00.068) 0:03:49.850 ******* 2019-11-25T09:20:56.131 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-25T09:20:56.133 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-11-25T09:20:56.168 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:56 +0000 (0:00:00.201) 0:03:50.052 ******* 2019-11-25T09:20:56.196 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-25T09:20:56.198 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:56.234 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:56 +0000 (0:00:00.066) 0:03:50.118 ******* 2019-11-25T09:20:56.397 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-11-25T09:20:56.399 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target polkit.service dbus.service system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service iptables.service ip6tables.service ebtables.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-25T09:20:56.401 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-25T09:20:56.402 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-25T09:20:56.436 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:56 +0000 (0:00:00.201) 0:03:50.319 ******* 2019-11-25T09:20:56.612 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice dbus.service basic.target polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ebtables.service ip6tables.service iptables.service shutdown.target ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-11-25T09:20:56.615 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-11-25T09:20:56.625 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-25T09:20:56.644 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:56 +0000 (0:00:00.207) 0:03:50.527 ******* 2019-11-25T09:20:56.835 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-11-25T09:20:56.836 INFO:teuthology.task.ansible.out:fatal: [smithi174.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-25T09:20:56.887 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:56 +0000 (0:00:00.242) 0:03:50.770 ******* 2019-11-25T09:20:57.060 INFO:teuthology.task.ansible.out:fatal: [smithi135.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-11-25T09:20:57.139 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:57 +0000 (0:00:00.249) 0:03:51.020 ******* 2019-11-25T09:20:57.730 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-11-25T09:20:57.780 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:57 +0000 (0:00:00.635) 0:03:51.656 ******* 2019-11-25T09:20:57.813 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:57 +0000 (0:00:00.041) 0:03:51.697 ******* 2019-11-25T09:20:57.822 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-11-25T09:20:57.825 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:57.868 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:57 +0000 (0:00:00.052) 0:03:51.749 ******* 2019-11-25T09:20:57.876 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:57.909 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:57 +0000 (0:00:00.042) 0:03:51.792 ******* 2019-11-25T09:20:57.913 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-11-25T09:20:57.953 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:57 +0000 (0:00:00.044) 0:03:51.837 ******* 2019-11-25T09:20:58.001 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:57 +0000 (0:00:00.043) 0:03:51.881 ******* 2019-11-25T09:20:58.002 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-11-25T09:20:58.003 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.041 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.044) 0:03:51.925 ******* 2019-11-25T09:20:58.048 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.085 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.043) 0:03:51.969 ******* 2019-11-25T09:20:58.095 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.129 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.043) 0:03:52.013 ******* 2019-11-25T09:20:58.137 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.183 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.049) 0:03:52.062 ******* TASK [testnode : Install apt keys] ********************************************* 2019-11-25T09:20:58.184 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.239 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.061) 0:03:52.123 ******* 2019-11-25T09:20:58.246 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.246 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.288 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.048) 0:03:52.172 ******* 2019-11-25T09:20:58.292 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-11-25T09:20:58.293 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.331 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.042) 0:03:52.214 ******* 2019-11-25T09:20:58.338 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.375 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.044) 0:03:52.259 ******* 2019-11-25T09:20:58.381 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-11-25T09:20:58.419 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.043) 0:03:52.303 ******* 2019-11-25T09:20:58.463 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.043) 0:03:52.347 ******* 2019-11-25T09:20:58.471 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-11-25T09:20:58.474 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.508 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.044) 0:03:52.391 ******* 2019-11-25T09:20:58.514 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.552 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.044) 0:03:52.436 ******* 2019-11-25T09:20:58.564 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.601 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.048) 0:03:52.484 ******* 2019-11-25T09:20:58.607 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.644 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.043) 0:03:52.528 ******* 2019-11-25T09:20:58.651 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.689 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.044) 0:03:52.572 ******* 2019-11-25T09:20:58.695 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.734 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.045) 0:03:52.617 ******* 2019-11-25T09:20:58.738 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-25T09:20:58.738 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.776 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.042) 0:03:52.660 ******* 2019-11-25T09:20:58.785 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.822 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.045) 0:03:52.705 ******* 2019-11-25T09:20:58.828 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-11-25T09:20:58.828 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.867 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.044) 0:03:52.750 ******* 2019-11-25T09:20:58.872 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.910 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.043) 0:03:52.794 ******* 2019-11-25T09:20:58.915 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-25T09:20:58.916 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:58.955 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.043) 0:03:52.837 ******* 2019-11-25T09:20:58.959 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.004 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:58 +0000 (0:00:00.043) 0:03:52.880 ******* TASK [testnode : Install non aarch64 packages] ********************************* 2019-11-25T09:20:59.006 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.040 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.043) 0:03:52.924 ******* 2019-11-25T09:20:59.047 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.085 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.044) 0:03:52.968 ******* 2019-11-25T09:20:59.090 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-11-25T09:20:59.091 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.130 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.045) 0:03:53.014 ******* 2019-11-25T09:20:59.138 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.176 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.045) 0:03:53.059 ******* 2019-11-25T09:20:59.181 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-11-25T09:20:59.183 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.219 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.043) 0:03:53.103 ******* 2019-11-25T09:20:59.228 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.264 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.044) 0:03:53.147 ******* 2019-11-25T09:20:59.270 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-11-25T09:20:59.271 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.310 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.046) 0:03:53.193 ******* 2019-11-25T09:20:59.316 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.355 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.045) 0:03:53.239 ******* 2019-11-25T09:20:59.361 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-11-25T09:20:59.363 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.400 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.044) 0:03:53.283 ******* 2019-11-25T09:20:59.406 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.443 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.042) 0:03:53.326 ******* 2019-11-25T09:20:59.452 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-11-25T09:20:59.454 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.489 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.046) 0:03:53.373 ******* 2019-11-25T09:20:59.496 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.534 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.044) 0:03:53.417 ******* 2019-11-25T09:20:59.539 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-11-25T09:20:59.542 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.590 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.055) 0:03:53.473 ******* 2019-11-25T09:20:59.604 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.634 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.044) 0:03:53.518 ******* 2019-11-25T09:20:59.640 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-11-25T09:20:59.642 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.678 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.044) 0:03:53.562 ******* 2019-11-25T09:20:59.688 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.733 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.054) 0:03:53.617 ******* 2019-11-25T09:20:59.739 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-11-25T09:20:59.741 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.779 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.044) 0:03:53.661 ******* 2019-11-25T09:20:59.784 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.823 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.045) 0:03:53.707 ******* 2019-11-25T09:20:59.829 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.869 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.045) 0:03:53.752 ******* 2019-11-25T09:20:59.876 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.914 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.045) 0:03:53.798 ******* 2019-11-25T09:20:59.923 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-11-25T09:20:59.924 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:20:59.972 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:20:59 +0000 (0:00:00.057) 0:03:53.855 ******* 2019-11-25T09:20:59.979 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.020 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.048) 0:03:53.904 ******* 2019-11-25T09:21:00.032 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-11-25T09:21:00.033 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.076 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.053) 0:03:53.957 ******* 2019-11-25T09:21:00.081 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.122 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.048) 0:03:54.006 ******* 2019-11-25T09:21:00.130 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.168 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.046) 0:03:54.052 ******* 2019-11-25T09:21:00.177 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.213 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.045) 0:03:54.097 ******* 2019-11-25T09:21:00.219 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-11-25T09:21:00.220 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.258 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.044) 0:03:54.142 ******* 2019-11-25T09:21:00.265 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.304 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.045) 0:03:54.187 ******* 2019-11-25T09:21:00.310 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-11-25T09:21:00.312 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.352 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.046) 0:03:54.234 ******* 2019-11-25T09:21:00.357 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.405 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.048) 0:03:54.283 ******* 2019-11-25T09:21:00.412 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.448 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.048) 0:03:54.331 ******* 2019-11-25T09:21:00.455 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.496 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.048) 0:03:54.379 ******* 2019-11-25T09:21:00.501 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-11-25T09:21:00.502 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.544 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.048) 0:03:54.427 ******* 2019-11-25T09:21:00.551 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.593 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.048) 0:03:54.476 ******* 2019-11-25T09:21:00.598 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-11-25T09:21:00.599 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.640 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.047) 0:03:54.523 ******* 2019-11-25T09:21:00.648 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.687 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.047) 0:03:54.571 ******* 2019-11-25T09:21:00.693 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-11-25T09:21:00.694 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.732 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.044) 0:03:54.615 ******* 2019-11-25T09:21:00.739 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.779 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.047) 0:03:54.663 ******* 2019-11-25T09:21:00.793 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.824 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.044) 0:03:54.708 ******* 2019-11-25T09:21:00.830 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:00.868 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:00 +0000 (0:00:00.043) 0:03:54.751 ******* 2019-11-25T09:21:01.147 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-25T09:21:01.148 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-25T09:21:01.209 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:01 +0000 (0:00:00.341) 0:03:55.093 ******* 2019-11-25T09:21:01.216 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-11-25T09:21:01.259 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:01 +0000 (0:00:00.047) 0:03:55.140 ******* 2019-11-25T09:21:01.488 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-25T09:21:01.489 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-25T09:21:01.532 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:01 +0000 (0:00:00.275) 0:03:55.415 ******* 2019-11-25T09:21:01.606 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-25T09:21:01.683 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:01 +0000 (0:00:00.150) 0:03:55.566 ******* 2019-11-25T09:21:01.843 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-25T09:21:01.845 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-25T09:21:01.889 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:01 +0000 (0:00:00.206) 0:03:55.773 ******* 2019-11-25T09:21:01.918 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-25T09:21:01.920 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:01.957 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:01 +0000 (0:00:00.068) 0:03:55.841 ******* 2019-11-25T09:21:01.985 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-25T09:21:01.986 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.036 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.077) 0:03:55.918 ******* 2019-11-25T09:21:02.049 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-25T09:21:02.050 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-11-25T09:21:02.089 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.054) 0:03:55.972 ******* 2019-11-25T09:21:02.094 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-25T09:21:02.095 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.133 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.044) 0:03:56.017 ******* 2019-11-25T09:21:02.139 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-25T09:21:02.141 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.179 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.045) 0:03:56.062 ******* 2019-11-25T09:21:02.184 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-25T09:21:02.185 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.223 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.043) 0:03:56.106 ******* 2019-11-25T09:21:02.229 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-25T09:21:02.230 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.268 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.045) 0:03:56.152 ******* 2019-11-25T09:21:02.280 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.312 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.043) 0:03:56.196 ******* 2019-11-25T09:21:02.318 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-11-25T09:21:02.320 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.363 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.050) 0:03:56.246 ******* 2019-11-25T09:21:02.369 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-25T09:21:02.370 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.408 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.045) 0:03:56.291 ******* 2019-11-25T09:21:02.414 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-25T09:21:02.415 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.456 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.047) 0:03:56.339 ******* 2019-11-25T09:21:02.464 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-11-25T09:21:02.466 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.502 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.046) 0:03:56.386 ******* 2019-11-25T09:21:02.509 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-25T09:21:02.509 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.547 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.044) 0:03:56.430 ******* 2019-11-25T09:21:02.555 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.592 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.045) 0:03:56.476 ******* 2019-11-25T09:21:02.598 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-25T09:21:02.600 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.638 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.045) 0:03:56.522 ******* 2019-11-25T09:21:02.645 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-11-25T09:21:02.646 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.687 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.048) 0:03:56.570 ******* 2019-11-25T09:21:02.695 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.734 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.047) 0:03:56.618 ******* 2019-11-25T09:21:02.740 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-25T09:21:02.741 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.779 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.044) 0:03:56.662 ******* 2019-11-25T09:21:02.785 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-11-25T09:21:02.787 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.832 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.046) 0:03:56.709 ******* TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-25T09:21:02.833 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.871 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.045) 0:03:56.754 ******* 2019-11-25T09:21:02.879 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.915 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.043) 0:03:56.798 ******* 2019-11-25T09:21:02.920 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-25T09:21:02.922 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:02.959 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:02 +0000 (0:00:00.043) 0:03:56.842 ******* 2019-11-25T09:21:02.964 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-11-25T09:21:02.965 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.004 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.046) 0:03:56.888 ******* 2019-11-25T09:21:03.009 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-25T09:21:03.012 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.052 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.044) 0:03:56.932 ******* 2019-11-25T09:21:03.054 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-11-25T09:21:03.056 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.094 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.045) 0:03:56.978 ******* 2019-11-25T09:21:03.100 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-11-25T09:21:03.100 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.154 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.060) 0:03:57.038 ******* 2019-11-25T09:21:03.161 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-11-25T09:21:03.163 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.201 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.046) 0:03:57.084 ******* 2019-11-25T09:21:03.207 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-25T09:21:03.208 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.246 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.045) 0:03:57.129 ******* 2019-11-25T09:21:03.252 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-11-25T09:21:03.254 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.292 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.046) 0:03:57.176 ******* 2019-11-25T09:21:03.298 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-25T09:21:03.306 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.338 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.046) 0:03:57.222 ******* 2019-11-25T09:21:03.352 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.393 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.054) 0:03:57.276 ******* 2019-11-25T09:21:03.398 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-25T09:21:03.400 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.442 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.049) 0:03:57.326 ******* 2019-11-25T09:21:03.449 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-11-25T09:21:03.450 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.496 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.054) 0:03:57.380 ******* 2019-11-25T09:21:03.506 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-25T09:21:03.508 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.549 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.052) 0:03:57.433 ******* 2019-11-25T09:21:03.556 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-11-25T09:21:03.563 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.600 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.051) 0:03:57.484 ******* 2019-11-25T09:21:03.620 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.652 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.051) 0:03:57.536 ******* 2019-11-25T09:21:03.659 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-11-25T09:21:03.661 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.710 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.057) 0:03:57.594 ******* 2019-11-25T09:21:03.718 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.763 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.052) 0:03:57.646 ******* 2019-11-25T09:21:03.772 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-11-25T09:21:03.775 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.811 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.047) 0:03:57.694 ******* 2019-11-25T09:21:03.819 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-11-25T09:21:03.820 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.860 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.049) 0:03:57.744 ******* 2019-11-25T09:21:03.867 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-11-25T09:21:03.869 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.914 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.052) 0:03:57.797 ******* 2019-11-25T09:21:03.920 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-11-25T09:21:03.921 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:03.959 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.045) 0:03:57.842 ******* 2019-11-25T09:21:03.968 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.004 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:03 +0000 (0:00:00.045) 0:03:57.887 ******* 2019-11-25T09:21:04.015 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi135.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-25T09:21:04.050 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.045) 0:03:57.933 ******* 2019-11-25T09:21:04.058 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.097 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.046) 0:03:57.980 ******* 2019-11-25T09:21:04.113 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi135.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.125 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.127 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** ok: [smithi135.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-11-25T09:21:04.188 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.076) 0:03:58.056 ******* skipping: [smithi135.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.238 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.065) 0:03:58.121 ******* 2019-11-25T09:21:04.244 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-25T09:21:04.246 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-11-25T09:21:04.284 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.044) 0:03:58.166 ******* 2019-11-25T09:21:04.324 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi174.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.349 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi174.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.360 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.373 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.383 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.394 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.398 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-25T09:21:04.400 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004292", "end": "2019-11-25 09:21:04.372792", "rc": 0, "start": "2019-11-25 09:21:04.368500", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-25T09:21:04.440 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.157) 0:03:58.323 ******* 2019-11-25T09:21:04.481 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.041) 0:03:58.365 ******* 2019-11-25T09:21:04.496 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.544 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.062) 0:03:58.427 ******* 2019-11-25T09:21:04.581 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-25T09:21:04.582 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.626 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.081) 0:03:58.509 ******* 2019-11-25T09:21:04.632 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-11-25T09:21:04.633 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004014", "end": "2019-11-25 09:21:04.608655", "rc": 0, "start": "2019-11-25 09:21:04.604641", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-11-25T09:21:04.685 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.058) 0:03:58.568 ******* 2019-11-25T09:21:04.691 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-25T09:21:04.693 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.734 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.049) 0:03:58.617 ******* 2019-11-25T09:21:04.739 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-11-25T09:21:04.741 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.793 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.058) 0:03:58.676 ******* 2019-11-25T09:21:04.804 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.840 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.047) 0:03:58.724 ******* 2019-11-25T09:21:04.846 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-11-25T09:21:04.847 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.888 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.046) 0:03:58.771 ******* 2019-11-25T09:21:04.925 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-11-25T09:21:04.926 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:04.966 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:04 +0000 (0:00:00.078) 0:03:58.849 ******* 2019-11-25T09:21:04.992 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-11-25T09:21:04.994 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:05.031 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:05 +0000 (0:00:00.065) 0:03:58.915 ******* 2019-11-25T09:21:05.327 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-11-25T09:21:05.329 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-25T09:21:05.386 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:05 +0000 (0:00:00.354) 0:03:59.269 ******* 2019-11-25T09:21:05.439 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-25T09:21:05.440 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item={u'block_used': 13037852, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286632, u'size_available': 930966044672, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286632, "block_size": 4096, "block_total": 240324484, "block_used": 13037852, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966044672, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-25T09:21:05.481 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:05 +0000 (0:00:00.095) 0:03:59.365 ******* 2019-11-25T09:21:05.521 INFO:teuthology.task.ansible.out: 2019-11-25T09:21:05.523 INFO:teuthology.task.ansible.out:TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-11-25T09:21:05.565 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:05 +0000 (0:00:00.084) 0:03:59.449 ******* 2019-11-25T09:21:05.612 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-11-25T09:21:05.613 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item={u'block_used': 13037848, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286636, u'size_available': 930966061056, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286636, "block_size": 4096, "block_total": 240324484, "block_used": 13037848, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966061056, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-11-25T09:21:05.664 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:05 +0000 (0:00:00.089) 0:03:59.538 ******* 2019-11-25T09:21:05.812 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-11-25T09:21:05.814 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.011746", "end": "2019-11-25 09:21:05.784386", "rc": 0, "start": "2019-11-25 09:21:05.772640", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:05.856 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:05 +0000 (0:00:00.199) 0:03:59.738 ******* 2019-11-25T09:21:05.908 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-11-25T09:21:05.909 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={u'block_used': 13037852, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286632, u'size_available': 930966044672, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286632, "block_size": 4096, "block_total": 240324484, "block_used": 13037852, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966044672, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:05.978 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:05 +0000 (0:00:00.118) 0:03:59.856 ******* 2019-11-25T09:21:06.198 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.013980", "end": "2019-11-25 09:21:05.943926", "rc": 0, "start": "2019-11-25 09:21:05.929946", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Monday 25 November 2019 09:21:06 +0000 (0:00:00.050) 0:03:59.907 ******* TASK [testnode : Wipe filesystems on non-root partitions] ********************** Monday 25 November 2019 09:21:06 +0000 (0:00:00.045) 0:03:59.952 ******* TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi174.front.sepia.ceph.com] => (item={u'block_used': 13037848, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286636, u'size_available': 930966061056, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286636, "block_size": 4096, "block_total": 240324484, "block_used": 13037848, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966061056, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} Monday 25 November 2019 09:21:06 +0000 (0:00:00.050) 0:04:00.002 ******* TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'lab 2019-11-25T09:21:06.199 INFO:teuthology.task.ansible.out:els': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XP97', u'wwn-0x5000c5009292802f'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XP97', u'wwn': u'0x5000c5009292802f', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XP97-part1', u'wwn-0x5000c5009292802f-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP97", "wwn-0x5000c5009292802f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP97-part1", "wwn-0x5000c5009292802f-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XP97", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009292802f"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Wipe filesystems on 2019-11-25T09:21:06.201 INFO:teuthology.task.ansible.out: non-root partitions] ********************** Monday 25 November 2019 09:21:06 +0000 (0:00:00.067) 0:04:00.070 ******* 2019-11-25T09:21:06.234 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-11-25T09:21:06.236 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z', u'wwn-0x5000c50092940234'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XN3Z', u'wwn': u'0x5000c50092940234', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1', u'wwn-0x5000c50092940234-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z", "wwn-0x5000c50092940234"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1", "wwn-0x5000c50092940234-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XN3Z", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-25T09:21:06.237 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092940234"}}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:08.013 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-dBvGV6-gcnj-lfGv-LEA3-V7cx-6Zzg-f70SJ0', u'nvme-INTEL_SSDPEDMD400G4_PHFT620401BA400BGN', u'nvme-nvme.8086-50484654363230343031424134303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.555624", "end": "2019-11-25 09:21:07.946915", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-dBvGV6-gcnj-lfGv-LEA3-V7cx-6Zzg-f70SJ0", "nvme-INTEL_SSDPEDMD400G4_PHFT620401BA400BGN", "nvme-nvme.8086-50484654363230343031424134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:06.391291", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-25T09:21:08.015 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:08.047 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-Ntwyzk-nN53-hAWE-W6le-XfI3-P5Nd-GozOVV', u'nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN', u'nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.494296", "end": "2019-11-25 09:21:08.001255", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Ntwyzk-nN53-hAWE-W6le-XfI3-P5Nd-GozOVV", "nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN", "nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:06.506959", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-11-25T09:21:08.049 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:09.393 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YKReKBGOs1PKOyjgRCvCHt8FAnWxYeRy7'], u'uuids': [u'dfad9895-2c26-4cf5-b5ec-f9769b1a5140']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.053678", "end": "2019-11-25 09:21:09.345880", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YKReKBGOs1PKOyjgRCvCHt8FAnWxYeRy7"], "labels": [], "masters": [], "uuids": ["dfad9895-2c26-4cf5-b5ec-f9769b1a5140"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:08.292202", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:09.431 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQoQ2izN2BxkOGpHVjEXdIHjuF1W0t9zje'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.062717", "end": "2019-11-25 09:21:09.387613", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQoQ2izN2BxkOGpHVjEXdIHjuF1W0t9zje"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:08.324896", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:10.760 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YtlA6pCXdq0pkkp4IrNBbHYXa7IiCNfbF'], u'uuids': [u'15268888-bc98-4305-9b0a-3eadd0b49739']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.052640", "end": "2019-11-25 09:21:10.721915", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YtlA6pCXdq0pkkp4IrNBbHYXa7IiCNfbF"], "labels": [], "masters": [], "uuids": ["15268888-bc98-4305-9b0a-3eadd0b49739"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:09.669275", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:10.784 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQbmEn5Le8H3tMsLdubK6JYDhNh3P7efQM'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.044556", "end": "2019-11-25 09:21:10.749749", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQbmEn5Le8H3tMsLdubK6JYDhNh3P7efQM"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:09.705193", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:12.182 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YCHHuWpyklaE2WsMFQQdikqYf6difEGUL'], u'uuids': [u'a0fa4979-ccec-44a9-8083-cafa1d36c147']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.079364", "end": "2019-11-25 09:21:12.139889", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YCHHuWpyklaE2WsMFQQdikqYf6difEGUL"], "labels": [], "masters": [], "uuids": ["a0fa4979-ccec-44a9-8083-cafa1d36c147"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:11.060525", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:12.189 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQKUkk0Q3DsTNqdZRIfhuBDUUgGpu6eCfh'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.059093", "end": "2019-11-25 09:21:12.145021", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQKUkk0Q3DsTNqdZRIfhuBDUUgGpu6eCfh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:11.085928", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:13.557 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQwYEZLcWkUyG0QCd6lJPVTDhIgyXrKTlS'], u'uuids': [u'7fdea865-45da-4869-8f07-6a87f58fcafe']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.070232", "end": "2019-11-25 09:21:13.523967", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQwYEZLcWkUyG0QCd6lJPVTDhIgyXrKTlS"], "labels": [], "masters": [], "uuids": ["7fdea865-45da-4869-8f07-6a87f58fcafe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:12.453735", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:13.580 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0Ypnwgkg3bfVNAvxM7KlnsfGWrxMYAvumw'], u'uuids': [u'6d2780ac-e812-41ac-ad93-93fb01ac920b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.089469", "end": "2019-11-25 09:21:13.538712", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0Ypnwgkg3bfVNAvxM7KlnsfGWrxMYAvumw"], "labels": [], "masters": [], "uuids": ["6d2780ac-e812-41ac-ad93-93fb01ac920b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:12.449243", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:14.945 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0Y6rDhN8VccAVJi2QDC9ogSllUJXw3cwZR'], u'uuids': [u'758fe2a5-6038-4f76-9c02-1516864d0ebf']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.060581", "end": "2019-11-25 09:21:14.907434", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0Y6rDhN8VccAVJi2QDC9ogSllUJXw3cwZR"], "labels": [], "masters": [], "uuids": ["758fe2a5-6038-4f76-9c02-1516864d0ebf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:13.846853", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:14.956 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQ0VtiDbBsSSa5eGMiTpPN0lTsrvvNRtrl'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.068144", "end": "2019-11-25 09:21:14.912495", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQ0VtiDbBsSSa5eGMiTpPN0lTsrvvNRtrl"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:13.844351", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-11-25T09:21:15.017 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:15 +0000 (0:00:08.830) 0:04:08.901 ******* 2019-11-25T09:21:15.056 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:15 +0000 (0:00:00.038) 0:04:08.939 ******* 2019-11-25T09:21:15.064 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-11-25T09:21:15.069 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XP97', u'wwn-0x5000c5009292802f'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XP97', u'wwn': u'0x5000c5009292802f', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XP97-part1', u'wwn-0x5000c5009292802f-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP97", "wwn-0x5000c5009292802f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XP97-part1", "wwn-0x5000c5009292802f-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XP97", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-25T09:21:15.072 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c5009292802f"}}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:15.102 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z', u'wwn-0x5000c50092940234'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XN3Z', u'wwn': u'0x5000c50092940234', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1', u'wwn-0x5000c50092940234-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z", "wwn-0x5000c50092940234"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XN3Z-part1", "wwn-0x5000c50092940234-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XN3Z", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-11-25T09:21:15.104 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50092940234"}}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:15.429 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-dBvGV6-gcnj-lfGv-LEA3-V7cx-6Zzg-f70SJ0', u'nvme-INTEL_SSDPEDMD400G4_PHFT620401BA400BGN', u'nvme-nvme.8086-50484654363230343031424134303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.063046", "end": "2019-11-25 09:21:15.388602", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-dBvGV6-gcnj-lfGv-LEA3-V7cx-6Zzg-f70SJ0", "nvme-INTEL_SSDPEDMD400G4_PHFT620401BA400BGN", "nvme-nvme.8086-50484654363230343031424134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:15.325556", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-25T09:21:15.436 INFO:teuthology.task.ansible.out:pied, 0.0570259 s, 2.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0570259 s, 2.0 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:15.503 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-Ntwyzk-nN53-hAWE-W6le-XfI3-P5Nd-GozOVV', u'nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN', u'nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.086267", "end": "2019-11-25 09:21:15.472003", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Ntwyzk-nN53-hAWE-W6le-XfI3-P5Nd-GozOVV", "nvme-INTEL_SSDPEDMD400G4_PHFT62050074400BGN", "nvme-nvme.8086-50484654363230353030373434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:15.385736", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) co 2019-11-25T09:21:15.504 INFO:teuthology.task.ansible.out:pied, 0.0794429 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0794429 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:15.892 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YKReKBGOs1PKOyjgRCvCHt8FAnWxYeRy7'], u'uuids': [u'dfad9895-2c26-4cf5-b5ec-f9769b1a5140']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.179317", "end": "2019-11-25 09:21:15.839938", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YKReKBGOs1PKOyjgRCvCHt8FAnWxYeRy7"], "labels": [], "masters": [], "uuids": ["dfad9895-2c26-4cf5-b5ec-f9769b1a5140"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:15.660621", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.173978 s, 663 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.173978 s, 663 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:15.984 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQoQ2izN2BxkOGpHVjEXdIHjuF1W0t9zje'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.208515", "end": "2019-11-25 09:21:15.950801", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQoQ2izN2BxkOGpHVjEXdIHjuF1W0t9zje"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:15.742286", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.202069 s, 571 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.202069 s, 571 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:16.412 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YtlA6pCXdq0pkkp4IrNBbHYXa7IiCNfbF'], u'uuids': [u'15268888-bc98-4305-9b0a-3eadd0b49739']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.190934", "end": "2019-11-25 09:21:16.370786", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YtlA6pCXdq0pkkp4IrNBbHYXa7IiCNfbF"], "labels": [], "masters": [], "uuids": ["15268888-bc98-4305-9b0a-3eadd0b49739"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:16.179852", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.18421 s, 626 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.18421 s, 626 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:16.476 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQbmEn5Le8H3tMsLdubK6JYDhNh3P7efQM'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.180515", "end": "2019-11-25 09:21:16.437287", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQbmEn5Le8H3tMsLdubK6JYDhNh3P7efQM"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:16.256772", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.17446 s, 661 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.17446 s, 661 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:16.894 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YCHHuWpyklaE2WsMFQQdikqYf6difEGUL'], u'uuids': [u'a0fa4979-ccec-44a9-8083-cafa1d36c147']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.160258", "end": "2019-11-25 09:21:16.856702", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0YCHHuWpyklaE2WsMFQQdikqYf6difEGUL"], "labels": [], "masters": [], "uuids": ["a0fa4979-ccec-44a9-8083-cafa1d36c147"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:16.696444", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.153698 s, 750 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.153698 s, 750 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:16.940 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQKUkk0Q3DsTNqdZRIfhuBDUUgGpu6eCfh'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.177008", "end": "2019-11-25 09:21:16.904687", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQKUkk0Q3DsTNqdZRIfhuBDUUgGpu6eCfh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:16.727679", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.171428 s, 673 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.171428 s, 673 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:17.379 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0Ypnwgkg3bfVNAvxM7KlnsfGWrxMYAvumw'], u'uuids': [u'6d2780ac-e812-41ac-ad93-93fb01ac920b']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.195466", "end": "2019-11-25 09:21:17.348211", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0Ypnwgkg3bfVNAvxM7KlnsfGWrxMYAvumw"], "labels": [], "masters": [], "uuids": ["6d2780ac-e812-41ac-ad93-93fb01ac920b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:17.152745", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.189149 s, 610 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.189149 s, 610 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:17.423 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQwYEZLcWkUyG0QCd6lJPVTDhIgyXrKTlS'], u'uuids': [u'7fdea865-45da-4869-8f07-6a87f58fcafe']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.175163", "end": "2019-11-25 09:21:17.394006", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQwYEZLcWkUyG0QCd6lJPVTDhIgyXrKTlS"], "labels": [], "masters": [], "uuids": ["7fdea865-45da-4869-8f07-6a87f58fcafe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:17.218843", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.169126 s, 682 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.169126 s, 682 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:17.918 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0Y6rDhN8VccAVJi2QDC9ogSllUJXw3cwZR'], u'uuids': [u'758fe2a5-6038-4f76-9c02-1516864d0ebf']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.197970", "end": "2019-11-25 09:21:17.863861", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-6Qme11JC6He2B0fb3bOU92FGDdF6LV0Y6rDhN8VccAVJi2QDC9ogSllUJXw3cwZR"], "labels": [], "masters": [], "uuids": ["758fe2a5-6038-4f76-9c02-1516864d0ebf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:17.665891", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.191814 s, 601 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.191814 s, 601 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:17.969 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:17 +0000 (0:00:02.910) 0:04:11.849 ******* 2019-11-25T09:21:17.977 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQ0VtiDbBsSSa5eGMiTpPN0lTsrvvNRtrl'], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.196812", "end": "2019-11-25 09:21:17.895468", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-t3sDThacZuEaDlHyBkfYtTF5FLHPYpLQ0VtiDbBsSSa5eGMiTpPN0lTsrvvNRtrl"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-11-25 09:21:17.698656", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.190094 s, 607 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.190094 s, 607 MB/s"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:18.040 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:18 +0000 (0:00:00.074) 0:04:11.924 ******* 2019-11-25T09:21:18.338 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-11-25T09:21:18.340 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.083036", "end": "2019-11-25 09:21:18.296451", "rc": 0, "start": "2019-11-25 09:21:18.213415", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:18.375 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:18 +0000 (0:00:00.334) 0:04:12.258 ******* 2019-11-25T09:21:18.490 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.082488", "end": "2019-11-25 09:21:18.452986", "rc": 0, "start": "2019-11-25 09:21:18.370498", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:18.532 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:18 +0000 (0:00:00.156) 0:04:12.415 ******* 2019-11-25T09:21:18.822 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.108579", "end": "2019-11-25 09:21:18.783896", "rc": 0, "start": "2019-11-25 09:21:18.675317", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:18.864 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:18 +0000 (0:00:00.327) 0:04:12.743 ******* 2019-11-25T09:21:18.867 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.041295", "end": "2019-11-25 09:21:18.832843", "rc": 0, "start": "2019-11-25 09:21:18.791548", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:18.906 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:18 +0000 (0:00:00.046) 0:04:12.790 ******* 2019-11-25T09:21:18.913 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-11-25T09:21:18.954 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:18 +0000 (0:00:00.047) 0:04:12.838 ******* 2019-11-25T09:21:19.002 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:18 +0000 (0:00:00.048) 0:04:12.886 ******* 2019-11-25T09:21:19.008 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-11-25T09:21:19.009 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.050 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.046) 0:04:12.933 ******* 2019-11-25T09:21:19.056 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.097 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.046) 0:04:12.980 ******* 2019-11-25T09:21:19.102 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-11-25T09:21:19.104 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.141 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.044) 0:04:13.025 ******* 2019-11-25T09:21:19.148 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.186 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.044) 0:04:13.070 ******* 2019-11-25T09:21:19.192 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-25T09:21:19.194 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.236 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.047) 0:04:13.117 ******* 2019-11-25T09:21:19.241 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.281 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.047) 0:04:13.164 ******* 2019-11-25T09:21:19.287 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-11-25T09:21:19.288 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.326 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.045) 0:04:13.210 ******* 2019-11-25T09:21:19.331 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.370 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.043) 0:04:13.254 ******* 2019-11-25T09:21:19.656 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi135.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-25T09:21:19.694 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.324) 0:04:13.578 ******* 2019-11-25T09:21:19.701 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-11-25T09:21:19.741 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.046) 0:04:13.625 ******* 2019-11-25T09:21:19.752 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi135.front.sepia.ceph.com] => (item={u'block_used': 13037852, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286632, u'size_available': 930966044672, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286632, "block_size": 4096, "block_total": 240324484, "block_used": 13037852, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966044672, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.788 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.046) 0:04:13.672 ******* 2019-11-25T09:21:19.795 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={u'block_used': 13037848, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227286636, u'size_available': 930966061056, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966954, u'device': u'/dev/sda1', u'inode_used': 88022, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227286636, "block_size": 4096, "block_total": 240324484, "block_used": 13037848, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966954, "inode_total": 61054976, "inode_used": 88022, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930966061056, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.833 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.045) 0:04:13.717 ******* 2019-11-25T09:21:19.842 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-11-25T09:21:19.844 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.879 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.046) 0:04:13.763 ******* 2019-11-25T09:21:19.891 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.925 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.045) 0:04:13.809 ******* 2019-11-25T09:21:19.931 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-25T09:21:19.932 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:19.977 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:19 +0000 (0:00:00.051) 0:04:13.860 ******* 2019-11-25T09:21:19.983 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:20.021 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:20 +0000 (0:00:00.044) 0:04:13.905 ******* 2019-11-25T09:21:20.026 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-25T09:21:20.028 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:20.065 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:20 +0000 (0:00:00.044) 0:04:13.949 ******* 2019-11-25T09:21:20.072 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:20.110 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:20 +0000 (0:00:00.044) 0:04:13.993 ******* 2019-11-25T09:21:20.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-11-25T09:21:20.116 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:20.158 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:20 +0000 (0:00:00.048) 0:04:14.042 ******* 2019-11-25T09:21:20.166 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:20.205 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:20 +0000 (0:00:00.046) 0:04:14.089 ******* 2019-11-25T09:21:20.210 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-11-25T09:21:20.211 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:20.249 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:20 +0000 (0:00:00.043) 0:04:14.132 ******* 2019-11-25T09:21:20.255 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:20.293 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:20 +0000 (0:00:00.044) 0:04:14.176 ******* 2019-11-25T09:21:20.308 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:20.345 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:20 +0000 (0:00:00.052) 0:04:14.229 ******* 2019-11-25T09:21:20.352 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:20.391 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:20 +0000 (0:00:00.045) 0:04:14.274 ******* 2019-11-25T09:21:21.158 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-11-25T09:21:21.159 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-25T09:21:21.162 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-11-25T09:21:21.203 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:21 +0000 (0:00:00.812) 0:04:15.086 ******* 2019-11-25T09:21:21.238 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:21 +0000 (0:00:00.035) 0:04:15.122 ******* 2019-11-25T09:21:22.022 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-11-25T09:21:22.024 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-25T09:21:22.034 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-25T09:21:22.486 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-25T09:21:22.487 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-25T09:21:22.927 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-25T09:21:23.004 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-25T09:21:23.393 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-25T09:21:23.478 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-25T09:21:23.837 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-25T09:21:23.877 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:23 +0000 (0:00:02.638) 0:04:17.760 ******* 2019-11-25T09:21:23.935 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-11-25T09:21:23.975 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:23 +0000 (0:00:00.097) 0:04:17.858 ******* 2019-11-25T09:21:24.210 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-11-25T09:21:24.212 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-25T09:21:24.258 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:24 +0000 (0:00:00.283) 0:04:18.142 ******* 2019-11-25T09:21:24.308 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-11-25T09:21:24.310 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-11-25T09:21:24.311 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:24.373 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:24 +0000 (0:00:00.103) 0:04:18.246 ******* 2019-11-25T09:21:24.405 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:24.632 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-25T09:21:24.713 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-25T09:21:24.989 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-25T09:21:25.012 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-25T09:21:25.307 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-25T09:21:25.319 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-25T09:21:25.626 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-25T09:21:25.682 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:25 +0000 (0:00:01.320) 0:04:19.566 ******* 2019-11-25T09:21:25.704 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-11-25T09:21:25.742 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:25 +0000 (0:00:00.059) 0:04:19.626 ******* 2019-11-25T09:21:25.992 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-11-25T09:21:25.994 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-25T09:21:26.049 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:26 +0000 (0:00:00.306) 0:04:19.932 ******* 2019-11-25T09:21:26.079 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-11-25T09:21:26.116 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:26 +0000 (0:00:00.066) 0:04:19.999 ******* 2019-11-25T09:21:26.122 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-11-25T09:21:26.124 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-25T09:21:26.168 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:26 +0000 (0:00:00.052) 0:04:20.052 ******* 2019-11-25T09:21:26.174 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-11-25T09:21:26.234 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:26 +0000 (0:00:00.065) 0:04:20.118 ******* 2019-11-25T09:21:26.875 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-11-25T09:21:26.876 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true} 2019-11-25T09:21:26.921 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:26 +0000 (0:00:00.686) 0:04:20.804 ******* 2019-11-25T09:21:26.927 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true} 2019-11-25T09:21:26.970 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:26 +0000 (0:00:00.049) 0:04:20.854 ******* 2019-11-25T09:21:27.644 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-11-25T09:21:27.646 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-25T09:21:27.691 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:27 +0000 (0:00:00.716) 0:04:21.571 ******* 2019-11-25T09:21:27.696 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-11-25T09:21:27.740 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:27 +0000 (0:00:00.052) 0:04:21.623 ******* 2019-11-25T09:21:27.746 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-11-25T09:21:27.748 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:27.786 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:27 +0000 (0:00:00.046) 0:04:21.670 ******* 2019-11-25T09:21:27.797 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:27.831 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:27 +0000 (0:00:00.044) 0:04:21.715 ******* 2019-11-25T09:21:27.840 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-11-25T09:21:27.842 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:27.878 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:27 +0000 (0:00:00.046) 0:04:21.761 ******* 2019-11-25T09:21:27.885 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:27.925 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:27 +0000 (0:00:00.047) 0:04:21.809 ******* 2019-11-25T09:21:27.931 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-11-25T09:21:27.933 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:27.990 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:27 +0000 (0:00:00.051) 0:04:21.860 ******* skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:28.022 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.045) 0:04:21.905 ******* 2019-11-25T09:21:28.027 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-11-25T09:21:28.029 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:28.065 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.043) 0:04:21.949 ******* 2019-11-25T09:21:28.073 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:28.117 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.052) 0:04:22.001 ******* 2019-11-25T09:21:28.124 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-11-25T09:21:28.124 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:28.162 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.044) 0:04:22.046 ******* 2019-11-25T09:21:28.167 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:28.213 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.050) 0:04:22.096 ******* 2019-11-25T09:21:28.219 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-11-25T09:21:28.219 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:28.258 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.045) 0:04:22.142 ******* 2019-11-25T09:21:28.267 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:28.304 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.045) 0:04:22.187 ******* 2019-11-25T09:21:28.313 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-11-25T09:21:28.314 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:28.352 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.047) 0:04:22.235 ******* 2019-11-25T09:21:28.358 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:28.400 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.048) 0:04:22.284 ******* 2019-11-25T09:21:28.860 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-11-25T09:21:28.862 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-25T09:21:28.909 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.508) 0:04:22.793 ******* 2019-11-25T09:21:28.911 INFO:teuthology.task.ansible.out: 2019-11-25T09:21:28.916 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-11-25T09:21:28.917 INFO:teuthology.task.ansible.out: 2019-11-25T09:21:28.980 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:28 +0000 (0:00:00.067) 0:04:22.860 ******* 2019-11-25T09:21:28.983 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-11-25T09:21:28.984 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:29.023 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:29 +0000 (0:00:00.046) 0:04:22.907 ******* 2019-11-25T09:21:29.032 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:29.069 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:29 +0000 (0:00:00.045) 0:04:22.952 ******* 2019-11-25T09:21:29.075 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-11-25T09:21:29.077 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:29.127 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:29 +0000 (0:00:00.054) 0:04:23.007 ******* 2019-11-25T09:21:29.134 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:29.195 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:29 +0000 (0:00:00.052) 0:04:23.060 ******* 2019-11-25T09:21:30.049 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-25T09:21:30.050 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-25T09:21:30.088 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:30 +0000 (0:00:00.911) 0:04:23.971 ******* 2019-11-25T09:21:30.122 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-25T09:21:30.124 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:30.167 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:30 +0000 (0:00:00.074) 0:04:24.046 ******* 2019-11-25T09:21:30.169 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-11-25T09:21:30.170 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-11-25T09:21:30.208 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:30 +0000 (0:00:00.045) 0:04:24.091 ******* 2019-11-25T09:21:30.234 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-11-25T09:21:30.235 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:30.271 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:30 +0000 (0:00:00.062) 0:04:24.154 ******* 2019-11-25T09:21:30.618 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-25T09:21:30.620 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket -.mount syslog.target sntp.service system.slice basic.target ntpdate.service tmp.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target chronyd.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-25T09:21:30.622 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-25T09:21:30.623 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-25T09:21:30.658 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:30 +0000 (0:00:00.387) 0:04:24.542 ******* 2019-11-25T09:21:31.523 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-25T09:21:31.565 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:31 +0000 (0:00:00.906) 0:04:25.448 ******* 2019-11-25T09:21:31.594 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-25T09:21:31.596 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:31.656 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:31 +0000 (0:00:00.090) 0:04:25.539 ******* 2019-11-25T09:21:31.804 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-11-25T09:21:31.806 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sntp.service ntpdate.service systemd-journald.socket tmp.mount basic.target system.slice -.mount syslog.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target chronyd.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-11-25T09:21:31.808 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-11-25T09:21:31.809 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-11-25T09:21:31.875 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:31 +0000 (0:00:00.219) 0:04:25.758 ******* 2019-11-25T09:21:31.957 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-25T09:21:31.959 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-25T09:21:32.019 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:32 +0000 (0:00:00.144) 0:04:25.902 ******* 2019-11-25T09:21:32.800 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-11-25T09:21:32.802 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-11-25T09:21:32.844 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:32 +0000 (0:00:00.820) 0:04:26.723 ******* 2019-11-25T09:21:32.866 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-11-25T09:21:32.868 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:32.909 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:32 +0000 (0:00:00.069) 0:04:26.793 ******* 2019-11-25T09:21:32.948 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-25T09:21:32.950 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-25T09:21:32.992 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:32 +0000 (0:00:00.082) 0:04:26.875 ******* 2019-11-25T09:21:33.264 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-11-25T09:21:33.267 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-11-25T09:21:33.306 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:33 +0000 (0:00:00.313) 0:04:27.189 ******* 2019-11-25T09:21:34.252 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-11-25T09:21:34.253 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-11-25T09:21:34.291 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:34 +0000 (0:00:00.984) 0:04:28.174 ******* 2019-11-25T09:21:34.809 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-11-25T09:21:34.810 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-25T09:21:34.847 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:34 +0000 (0:00:00.556) 0:04:28.731 ******* 2019-11-25T09:21:34.874 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-25T09:21:34.876 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:34.914 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:34 +0000 (0:00:00.066) 0:04:28.797 ******* 2019-11-25T09:21:34.940 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-25T09:21:34.942 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-25T09:21:34.981 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:34 +0000 (0:00:00.066) 0:04:28.864 ******* 2019-11-25T09:21:35.304 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-25T09:21:35.306 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-25T09:21:35.340 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:35 +0000 (0:00:00.359) 0:04:29.223 ******* 2019-11-25T09:21:35.377 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-25T09:21:35.378 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:35.420 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:35 +0000 (0:00:00.080) 0:04:29.304 ******* 2019-11-25T09:21:35.457 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-11-25T09:21:35.459 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-25T09:21:35.495 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:35 +0000 (0:00:00.074) 0:04:29.379 ******* 2019-11-25T09:21:35.523 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-25T09:21:35.524 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:35.567 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:35 +0000 (0:00:00.071) 0:04:29.451 ******* 2019-11-25T09:21:35.778 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-11-25T09:21:35.823 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:35 +0000 (0:00:00.255) 0:04:29.706 ******* 2019-11-25T09:21:35.851 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-11-25T09:21:35.852 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:35.902 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:35 +0000 (0:00:00.079) 0:04:29.786 ******* 2019-11-25T09:21:35.912 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-25T09:21:35.913 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-25T09:21:35.956 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:35 +0000 (0:00:00.053) 0:04:29.840 ******* 2019-11-25T09:21:35.962 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-11-25T09:21:35.963 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-11-25T09:21:36.002 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:35 +0000 (0:00:00.045) 0:04:29.886 ******* 2019-11-25T09:21:36.283 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi174.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-25T09:21:36.328 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.325) 0:04:30.211 ******* 2019-11-25T09:21:36.344 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-11-25T09:21:36.346 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-11-25T09:21:36.390 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.062) 0:04:30.273 ******* 2019-11-25T09:21:36.405 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.446 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.055) 0:04:30.329 ******* 2019-11-25T09:21:36.451 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-11-25T09:21:36.451 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.500 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.053) 0:04:30.382 ******* 2019-11-25T09:21:36.506 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-25T09:21:36.508 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.509 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi174.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.547 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.048) 0:04:30.431 ******* 2019-11-25T09:21:36.563 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi135.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-11-25T09:21:36.595 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.047) 0:04:30.478 ******* 2019-11-25T09:21:36.603 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-25T09:21:36.604 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.605 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.617 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.618 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.619 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.659 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.063) 0:04:30.542 ******* 2019-11-25T09:21:36.664 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-11-25T09:21:36.666 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.705 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.046) 0:04:30.589 ******* 2019-11-25T09:21:36.732 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.780 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.075) 0:04:30.664 ******* 2019-11-25T09:21:36.816 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.856 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.065) 0:04:30.729 ******* 2019-11-25T09:21:36.883 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-11-25T09:21:36.884 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.926 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.080) 0:04:30.810 ******* 2019-11-25T09:21:36.954 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-11-25T09:21:36.955 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:36.997 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:36 +0000 (0:00:00.070) 0:04:30.881 ******* 2019-11-25T09:21:36.999 INFO:teuthology.task.ansible.out: 2019-11-25T09:21:37.014 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-11-25T09:21:37.015 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-11-25T09:21:37.060 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.063) 0:04:30.944 ******* 2019-11-25T09:21:37.068 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-25T09:21:37.071 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.114 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.053) 0:04:30.998 ******* 2019-11-25T09:21:37.141 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-25T09:21:37.143 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.184 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.069) 0:04:31.067 ******* 2019-11-25T09:21:37.221 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-25T09:21:37.223 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.265 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.081) 0:04:31.149 ******* 2019-11-25T09:21:37.303 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-25T09:21:37.305 INFO:teuthology.task.ansible.out:skipping: [smithi174.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.343 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.077) 0:04:31.226 ******* 2019-11-25T09:21:37.344 INFO:teuthology.task.ansible.out: 2019-11-25T09:21:37.400 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-11-25T09:21:37.401 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-11-25T09:21:37.439 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.096) 0:04:31.323 ******* 2019-11-25T09:21:37.468 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-11-25T09:21:37.470 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.517 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.077) 0:04:31.401 ******* 2019-11-25T09:21:37.554 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-11-25T09:21:37.556 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.566 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.567 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.580 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.581 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.619 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.102) 0:04:31.503 ******* 2019-11-25T09:21:37.657 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-11-25T09:21:37.658 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.660 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.682 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi135.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.693 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.755 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.136) 0:04:31.639 ******* 2019-11-25T09:21:37.762 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-25T09:21:37.766 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.015955", "end": "2019-11-25 09:21:37.666974", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-25 09:21:37.651019", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:37.777 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-11-25T09:21:37.778 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.824 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.068) 0:04:31.708 ******* 2019-11-25T09:21:37.852 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-11-25T09:21:37.853 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.921 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.096) 0:04:31.804 ******* 2019-11-25T09:21:37.952 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:37.999 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:37 +0000 (0:00:00.077) 0:04:31.882 ******* 2019-11-25T09:21:38.031 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:38.076 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:38 +0000 (0:00:00.072) 0:04:31.955 ******* 2019-11-25T09:21:38.080 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi174.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007515", "end": "2019-11-25 09:21:37.992768", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-25 09:21:37.985253", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:38.094 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-11-25T09:21:38.096 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:38.142 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:38 +0000 (0:00:00.068) 0:04:32.023 ******* 2019-11-25T09:21:38.167 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-11-25T09:21:38.168 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:38.218 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:38 +0000 (0:00:00.073) 0:04:32.096 ******* 2019-11-25T09:21:38.243 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-11-25T09:21:38.245 INFO:teuthology.task.ansible.out:skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:38.284 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:38 +0000 (0:00:00.071) 0:04:32.168 ******* 2019-11-25T09:21:38.312 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi135.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-11-25T09:21:38.369 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:38 +0000 (0:00:00.084) 0:04:32.253 ******* 2019-11-25T09:21:38.376 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-25T09:21:38.377 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006723", "end": "2019-11-25 09:21:38.297616", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-25 09:21:38.290893", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:38.671 INFO:teuthology.task.ansible.out:ok: [smithi174.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026846", "end": "2019-11-25 09:21:38.632579", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-25 09:21:38.605733", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:38.716 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:38 +0000 (0:00:00.347) 0:04:32.600 ******* 2019-11-25T09:21:38.725 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.016341", "end": "2019-11-25 09:21:38.672801", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-11-25 09:21:38.656460", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:38.749 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-25T09:21:38.789 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:38 +0000 (0:00:00.070) 0:04:32.670 ******* 2019-11-25T09:21:39.030 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-11-25T09:21:39.032 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006801", "end": "2019-11-25 09:21:38.983689", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-11-25 09:21:38.976888", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:39.115 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-25T09:21:39.116 INFO:teuthology.task.ansible.out:changed: [smithi174.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-25T09:21:39.347 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi135.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.006976", "end": "2019-11-25 09:21:39.306701", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-11-25 09:21:39.299725", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:40.690 INFO:teuthology.task.ansible.out:ok: [smithi135.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:01.044772", "end": "2019-11-25 09:21:40.637103", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-11-25 09:21:39.592331", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-11-25T09:21:40.753 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:40 +0000 (0:00:01.962) 0:04:34.632 ******* 2019-11-25T09:21:40.778 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-11-25T09:21:40.822 INFO:teuthology.task.ansible.out:Monday 25 November 2019 09:21:40 +0000 (0:00:00.073) 0:04:34.706 ******* 2019-11-25T09:21:41.158 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-11-25T09:21:41.160 INFO:teuthology.task.ansible.out:changed: [smithi135.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-11-25T09:21:41.269 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-11-25T09:21:41.272 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-11-25T09:21:41.274 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2019-11-25T09:21:41.275 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi135.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 smithi174.front.sepia.ceph.com : ok=121 changed=39 unreachable=0 failed=0 skipped=159 rescued=0 ignored=3 Monday 25 November 2019 09:21:41 +0000 (0:00:00.452) 0:04:35.158 ******* =============================================================================== 2019-11-25T09:21:41.281 INFO:teuthology.task.ansible.out:users : Create all admin users with sudo access. ----------------------- 40.22s users : Update authorized_keys using the keys repo --------------------- 38.40s testnode : Install packages -------------------------------------------- 20.96s common : Update yum cache ---------------------------------------------- 11.48s 2019-11-25T09:21:41.283 INFO:teuthology.task.ansible.out:testnode : Ensure ceph packages are not present. ----------------------- 10.53s testnode : Zap all non-root disks --------------------------------------- 8.83s users : Remove revoked users -------------------------------------------- 8.67s common : nrpe - Remove SELinux policy package --------------------------- 8.32s common : nrpe - Load SELinux policy package ----------------------------- 7.98s common : Make sure smartmontools is installed --------------------------- 3.75s testnode : Ensure ceph dependency packages are not present. ------------- 3.46s Gathering Facts --------------------------------------------------------- 3.36s testnode : Blow away lingering OSD data and FSIDs ----------------------- 2.91s ansible-managed : Add authorized keys for the ansible user. ------------- 2.80s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 2.72s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 2.70s testnode : Create logical volume(s) ------------------------------------- 2.64s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 2.51s users : Update authorized_keys for each user with literal keys ---------- 2.47s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 2.45s 2019-11-25T09:21:41.560 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi174.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2019-11-25T09:21:41.562 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:21:41.563 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi174.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:21:41.666 INFO:teuthology.orchestra.run.smithi174:> true 2019-11-25T09:21:42.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-11-25T09:21:42.035 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi135.front.sepia.ceph.com', 'timeout': 60} 2019-11-25T09:21:42.145 INFO:teuthology.orchestra.run.smithi135:> true 2019-11-25T09:21:42.531 INFO:teuthology.run_tasks:Running task clock... 2019-11-25T09:21:42.544 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-11-25T09:21:42.545 INFO:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-25T09:21:42.670 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-25T09:21:52.756 INFO:teuthology.orchestra.run.smithi174.stdout:ntpd: time slew -0.000871s 2019-11-25T09:21:52.796 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit not found. 2019-11-25T09:21:52.928 INFO:teuthology.orchestra.run.smithi174.stdout: remote refid st t when poll reach delay offset jitter 2019-11-25T09:21:52.929 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================== 2019-11-25T09:21:52.929 INFO:teuthology.orchestra.run.smithi174.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-25T09:21:52.929 INFO:teuthology.orchestra.run.smithi174.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-25T09:21:52.929 INFO:teuthology.orchestra.run.smithi174.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-25T09:21:52.929 INFO:teuthology.orchestra.run.smithi174.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-25T09:21:52.930 INFO:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-11-25T09:21:53.071 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-11-25T09:22:03.158 INFO:teuthology.orchestra.run.smithi135.stdout:ntpd: time slew +0.003516s 2019-11-25T09:22:03.198 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit not found. 2019-11-25T09:22:03.306 INFO:teuthology.orchestra.run.smithi135.stdout: remote refid st t when poll reach delay offset jitter 2019-11-25T09:22:03.307 INFO:teuthology.orchestra.run.smithi135.stdout:============================================================================== 2019-11-25T09:22:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-25T09:22:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-25T09:22:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-25T09:22:03.307 INFO:teuthology.orchestra.run.smithi135.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-11-25T09:22:03.307 INFO:teuthology.run_tasks:Running task install... 2019-11-25T09:22:03.320 DEBUG:teuthology.task.install:project ceph 2019-11-25T09:22:03.320 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'notcmalloc', 'sha1': '12b9659be24ae0e3d791f80d81504ab2770c1343'}} 2019-11-25T09:22:03.321 DEBUG:teuthology.task.install:config {'flavor': 'notcmalloc', 'sha1': '12b9659be24ae0e3d791f80d81504ab2770c1343'} 2019-11-25T09:22:03.321 INFO:teuthology.task.install:Using flavor: notcmalloc 2019-11-25T09:22:03.325 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-11-25T09:22:03.325 INFO:teuthology.task.install:extra packages: [] 2019-11-25T09:22:03.326 INFO:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2019-11-25T09:22:03.487 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS 2019-11-25T09:22:03.489 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-25T09:22:03.489 INFO:teuthology.orchestra.run.smithi135:> sudo lsb_release -is 2019-11-25T09:22:03.489 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '12b9659be24ae0e3d791f80d81504ab2770c1343', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-25T09:22:03.490 INFO:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2019-11-25T09:22:03.619 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS 2019-11-25T09:22:03.621 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-25T09:22:03.622 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=12b9659be24ae0e3d791f80d81504ab2770c1343 2019-11-25T09:22:03.647 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS 2019-11-25T09:22:03.664 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-25T09:22:03.665 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '12b9659be24ae0e3d791f80d81504ab2770c1343', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-11-25T09:22:03.665 INFO:teuthology.orchestra.run.smithi135:> sudo lsb_release -is 2019-11-25T09:22:03.806 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuval-add-kafka-security2/12b9659be24ae0e3d791f80d81504ab2770c1343/centos/7/flavors/notcmalloc/ 2019-11-25T09:22:03.806 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7614.g12b9659 2019-11-25T09:22:03.812 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS 2019-11-25T09:22:03.815 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-25T09:22:03.815 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=12b9659be24ae0e3d791f80d81504ab2770c1343 2019-11-25T09:22:03.921 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-25T09:22:03.974 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuval-add-kafka-security2/12b9659be24ae0e3d791f80d81504ab2770c1343/centos/7/flavors/notcmalloc/ 2019-11-25T09:22:03.974 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7614.g12b9659 2019-11-25T09:22:04.052 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-25T09:22:04.052 INFO:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/12b9659be24ae0e3d791f80d81504ab2770c1343/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-25T09:22:04.096 INFO:teuthology.orchestra.run.smithi135:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-11-25T09:22:04.163 INFO:teuthology.orchestra.run.smithi174:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-25T09:22:04.216 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-11-25T09:22:04.216 INFO:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/12b9659be24ae0e3d791f80d81504ab2770c1343/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-11-25T09:22:04.245 INFO:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-25T09:22:04.321 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2019-11-25T09:22:04.322 INFO:teuthology.orchestra.run.smithi174:> sudo yum clean all 2019-11-25T09:22:04.331 INFO:teuthology.orchestra.run.smithi135:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-11-25T09:22:04.444 INFO:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-11-25T09:22:04.497 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:22:04.536 INFO:teuthology.orchestra.run.smithi174.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-25T09:22:04.536 INFO:teuthology.orchestra.run.smithi174.stdout: : lab-extras updates 2019-11-25T09:22:04.543 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2019-11-25T09:22:04.546 INFO:teuthology.orchestra.run.smithi135:> sudo yum clean all 2019-11-25T09:22:04.580 INFO:teuthology.orchestra.run.smithi174.stdout:Cleaning up list of fastest mirrors 2019-11-25T09:22:04.580 INFO:teuthology.orchestra.run.smithi174.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-25T09:22:04.593 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw 2019-11-25T09:22:04.738 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:22:04.757 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:22:04.777 INFO:teuthology.orchestra.run.smithi135.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-11-25T09:22:04.777 INFO:teuthology.orchestra.run.smithi135.stdout: : lab-extras updates 2019-11-25T09:22:04.793 INFO:teuthology.orchestra.run.smithi174.stdout:Determining fastest mirrors 2019-11-25T09:22:04.821 INFO:teuthology.orchestra.run.smithi135.stdout:Cleaning up list of fastest mirrors 2019-11-25T09:22:04.822 INFO:teuthology.orchestra.run.smithi135.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-11-25T09:22:04.835 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw 2019-11-25T09:22:05.073 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:22:05.114 INFO:teuthology.orchestra.run.smithi135.stdout:Determining fastest mirrors 2019-11-25T09:22:05.307 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:22:05.308 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:22:05.308 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:22:05.309 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:22:05.784 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:22:05.785 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:22:05.786 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:22:05.786 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:22:12.970 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:22:13.300 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:22:13.326 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:22:13.326 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:13.327 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.339 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.449 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.451 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.451 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.452 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.461 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.462 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.462 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.462 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.463 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:13.463 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-base.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.468 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.468 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.469 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.470 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.472 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.473 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.474 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-25T09:22:13.475 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-25T09:22:13.476 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-25T09:22:13.476 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librados2.x86_64 2:15.0.0-7614.g12b9659.el7 will be an update 2019-11-25T09:22:13.478 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-25T09:22:13.479 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librgw2.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.480 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:13.480 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-common.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.484 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.485 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.486 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.487 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.488 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.489 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.489 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.491 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.491 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.492 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.493 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.493 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-25T09:22:13.493 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.494 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-25T09:22:13.494 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librbd1.x86_64 2:15.0.0-7614.g12b9659.el7 will be an update 2019-11-25T09:22:13.494 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-25T09:22:13.495 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-25T09:22:13.496 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-25T09:22:13.497 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:13.497 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-25T09:22:13.498 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.499 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.499 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.499 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.501 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-25T09:22:13.501 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-rados.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.501 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-rbd.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.501 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-rgw.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.502 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-25T09:22:13.652 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:22:13.653 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:22:13.653 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.664 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.777 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.778 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.778 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.778 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.778 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.788 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.789 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.789 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.789 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:22:13.789 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-base.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.801 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.801 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.801 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.802 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.802 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.802 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.802 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-11-25T09:22:13.802 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-11-25T09:22:13.803 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-11-25T09:22:13.803 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package librados2.x86_64 2:15.0.0-7614.g12b9659.el7 will be an update 2019-11-25T09:22:13.805 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-11-25T09:22:13.806 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package librgw2.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.806 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:22:13.806 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-common.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.809 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.810 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.811 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.811 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.812 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.813 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.814 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.815 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.816 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.816 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.834 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:13.834 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-11-25T09:22:13.834 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.834 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-11-25T09:22:13.834 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package librbd1.x86_64 2:15.0.0-7614.g12b9659.el7 will be an update 2019-11-25T09:22:13.834 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-11-25T09:22:13.835 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-25T09:22:13.835 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-11-25T09:22:13.835 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:22:13.835 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-11-25T09:22:13.835 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.835 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.835 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.836 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.836 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-11-25T09:22:13.836 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-rados.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.836 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-rbd.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.837 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-rgw.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:13.837 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-11-25T09:22:14.361 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:22:14.445 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:14.445 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:22:14.449 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:14.449 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:22:14.449 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository 2019-11-25T09:22:14.449 INFO:teuthology.orchestra.run.smithi174.stdout: Size 2019-11-25T09:22:14.449 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:22:14.450 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:22:14.450 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:15.0.0-7614.g12b9659.el7 ceph 6.2 M 2019-11-25T09:22:14.450 INFO:teuthology.orchestra.run.smithi174.stdout:Installing for dependencies: 2019-11-25T09:22:14.450 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:15.0.0-7614.g12b9659.el7 ceph 5.6 M 2019-11-25T09:22:14.450 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:15.0.0-7614.g12b9659.el7 ceph 20 M 2019-11-25T09:22:14.450 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:15.0.0-7614.g12b9659.el7 ceph 20 k 2019-11-25T09:22:14.451 INFO:teuthology.orchestra.run.smithi174.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-25T09:22:14.451 INFO:teuthology.orchestra.run.smithi174.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-25T09:22:14.451 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:15.0.0-7614.g12b9659.el7 ceph 489 k 2019-11-25T09:22:14.451 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-25T09:22:14.451 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-25T09:22:14.451 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:15.0.0-7614.g12b9659.el7 ceph 374 k 2019-11-25T09:22:14.451 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-25T09:22:14.451 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:15.0.0-7614.g12b9659.el7 ceph 5.4 M 2019-11-25T09:22:14.452 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-25T09:22:14.452 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-argparse x86_64 2:15.0.0-7614.g12b9659.el7 ceph 35 k 2019-11-25T09:22:14.452 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-common x86_64 2:15.0.0-7614.g12b9659.el7 ceph 42 k 2019-11-25T09:22:14.452 INFO:teuthology.orchestra.run.smithi174.stdout: python-cephfs x86_64 2:15.0.0-7614.g12b9659.el7 ceph 102 k 2019-11-25T09:22:14.452 INFO:teuthology.orchestra.run.smithi174.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-25T09:22:14.453 INFO:teuthology.orchestra.run.smithi174.stdout: python-rados x86_64 2:15.0.0-7614.g12b9659.el7 ceph 209 k 2019-11-25T09:22:14.453 INFO:teuthology.orchestra.run.smithi174.stdout: python-rbd x86_64 2:15.0.0-7614.g12b9659.el7 ceph 199 k 2019-11-25T09:22:14.453 INFO:teuthology.orchestra.run.smithi174.stdout: python-rgw x86_64 2:15.0.0-7614.g12b9659.el7 ceph 77 k 2019-11-25T09:22:14.454 INFO:teuthology.orchestra.run.smithi174.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-25T09:22:14.454 INFO:teuthology.orchestra.run.smithi174.stdout:Updating for dependencies: 2019-11-25T09:22:14.454 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:15.0.0-7614.g12b9659.el7 ceph 3.5 M 2019-11-25T09:22:14.454 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:15.0.0-7614.g12b9659.el7 ceph 1.8 M 2019-11-25T09:22:14.454 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:14.454 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:22:14.454 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:22:14.455 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package (+20 Dependent packages) 2019-11-25T09:22:14.455 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade ( 2 Dependent packages) 2019-11-25T09:22:14.455 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:14.455 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 45 M 2019-11-25T09:22:14.455 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:22:14.455 INFO:teuthology.orchestra.run.smithi174.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-25T09:22:14.687 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:22:14.771 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:14.772 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:22:14.775 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:14.775 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:22:14.775 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository 2019-11-25T09:22:14.775 INFO:teuthology.orchestra.run.smithi135.stdout: Size 2019-11-25T09:22:14.775 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:22:14.775 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:22:14.776 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:15.0.0-7614.g12b9659.el7 ceph 6.2 M 2019-11-25T09:22:14.776 INFO:teuthology.orchestra.run.smithi135.stdout:Installing for dependencies: 2019-11-25T09:22:14.776 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:15.0.0-7614.g12b9659.el7 ceph 5.6 M 2019-11-25T09:22:14.776 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:15.0.0-7614.g12b9659.el7 ceph 20 M 2019-11-25T09:22:14.776 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:15.0.0-7614.g12b9659.el7 ceph 20 k 2019-11-25T09:22:14.776 INFO:teuthology.orchestra.run.smithi135.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-11-25T09:22:14.776 INFO:teuthology.orchestra.run.smithi135.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-11-25T09:22:14.777 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:15.0.0-7614.g12b9659.el7 ceph 489 k 2019-11-25T09:22:14.777 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-11-25T09:22:14.777 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-11-25T09:22:14.777 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:15.0.0-7614.g12b9659.el7 ceph 374 k 2019-11-25T09:22:14.777 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-11-25T09:22:14.777 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:15.0.0-7614.g12b9659.el7 ceph 5.4 M 2019-11-25T09:22:14.777 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-11-25T09:22:14.777 INFO:teuthology.orchestra.run.smithi135.stdout: python-ceph-argparse x86_64 2:15.0.0-7614.g12b9659.el7 ceph 35 k 2019-11-25T09:22:14.778 INFO:teuthology.orchestra.run.smithi135.stdout: python-ceph-common x86_64 2:15.0.0-7614.g12b9659.el7 ceph 42 k 2019-11-25T09:22:14.778 INFO:teuthology.orchestra.run.smithi135.stdout: python-cephfs x86_64 2:15.0.0-7614.g12b9659.el7 ceph 102 k 2019-11-25T09:22:14.778 INFO:teuthology.orchestra.run.smithi135.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-11-25T09:22:14.778 INFO:teuthology.orchestra.run.smithi135.stdout: python-rados x86_64 2:15.0.0-7614.g12b9659.el7 ceph 209 k 2019-11-25T09:22:14.778 INFO:teuthology.orchestra.run.smithi135.stdout: python-rbd x86_64 2:15.0.0-7614.g12b9659.el7 ceph 199 k 2019-11-25T09:22:14.778 INFO:teuthology.orchestra.run.smithi135.stdout: python-rgw x86_64 2:15.0.0-7614.g12b9659.el7 ceph 77 k 2019-11-25T09:22:14.778 INFO:teuthology.orchestra.run.smithi135.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-11-25T09:22:14.779 INFO:teuthology.orchestra.run.smithi135.stdout:Updating for dependencies: 2019-11-25T09:22:14.779 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:15.0.0-7614.g12b9659.el7 ceph 3.5 M 2019-11-25T09:22:14.779 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:15.0.0-7614.g12b9659.el7 ceph 1.8 M 2019-11-25T09:22:14.779 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:14.779 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:22:14.779 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:22:14.779 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package (+20 Dependent packages) 2019-11-25T09:22:14.780 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade ( 2 Dependent packages) 2019-11-25T09:22:14.780 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:14.780 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 45 M 2019-11-25T09:22:14.780 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:22:14.781 INFO:teuthology.orchestra.run.smithi135.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-11-25T09:22:16.589 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:22:16.589 INFO:teuthology.orchestra.run.smithi174.stdout:Total 21 MB/s | 45 MB 00:02 2019-11-25T09:22:16.605 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:22:16.676 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:22:16.942 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:22:16.943 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:22:17.637 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-25T09:22:17.986 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-25T09:22:18.317 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-25T09:22:18.619 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-ceph-argparse-15.0.0-7614.g12b9659.el7.x86_64 4/25 2019-11-25T09:22:18.943 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-25T09:22:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-25T09:22:20.110 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-11-25T09:22:20.429 INFO:teuthology.orchestra.run.smithi174.stdout: Updating : 2:librados2-15.0.0-7614.g12b9659.el7.x86_64 8/25 2019-11-25T09:22:20.780 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-rados-15.0.0-7614.g12b9659.el7.x86_64 9/25 2019-11-25T09:22:21.703 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:libcephfs2-15.0.0-7614.g12b9659.el7.x86_64 10/25 2019-11-25T09:22:22.242 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:librgw2-15.0.0-7614.g12b9659.el7.x86_64 11/25 2019-11-25T09:22:22.413 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:22:22.413 INFO:teuthology.orchestra.run.smithi135.stdout:Total 5.8 MB/s | 45 MB 00:07 2019-11-25T09:22:22.437 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:22:22.496 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:22:22.583 INFO:teuthology.orchestra.run.smithi174.stdout: Updating : 2:librbd1-15.0.0-7614.g12b9659.el7.x86_64 12/25 2019-11-25T09:22:22.792 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:22:22.792 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:22:22.878 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-rbd-15.0.0-7614.g12b9659.el7.x86_64 13/25 2019-11-25T09:22:23.155 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-rgw-15.0.0-7614.g12b9659.el7.x86_64 14/25 2019-11-25T09:22:23.493 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-cephfs-15.0.0-7614.g12b9659.el7.x86_64 15/25 2019-11-25T09:22:23.517 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-11-25T09:22:23.763 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:libradosstriper1-15.0.0-7614.g12b9659.el7.x86_64 16/25 2019-11-25T09:22:23.882 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-11-25T09:22:24.032 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-11-25T09:22:24.247 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-11-25T09:22:24.311 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-ceph-common-15.0.0-7614.g12b9659.el7.x86_64 18/25 2019-11-25T09:22:24.571 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:python-ceph-argparse-15.0.0-7614.g12b9659.el7.x86_64 4/25 2019-11-25T09:22:24.918 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 5/25 2019-11-25T09:22:25.330 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-11-25T09:22:26.119 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-11-25T09:22:26.562 INFO:teuthology.orchestra.run.smithi135.stdout: Updating : 2:librados2-15.0.0-7614.g12b9659.el7.x86_64 8/25 2019-11-25T09:22:26.908 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 19/25 2019-11-25T09:22:26.986 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:python-rados-15.0.0-7614.g12b9659.el7.x86_64 9/25 2019-11-25T09:22:27.908 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:libcephfs2-15.0.0-7614.g12b9659.el7.x86_64 10/25 2019-11-25T09:22:28.030 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 20/25 2019-11-25T09:22:28.412 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:librgw2-15.0.0-7614.g12b9659.el7.x86_64 11/25 2019-11-25T09:22:28.622 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 21/25 2019-11-25T09:22:28.753 INFO:teuthology.orchestra.run.smithi135.stdout: Updating : 2:librbd1-15.0.0-7614.g12b9659.el7.x86_64 12/25 2019-11-25T09:22:29.030 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:python-rbd-15.0.0-7614.g12b9659.el7.x86_64 13/25 2019-11-25T09:22:29.316 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:python-rgw-15.0.0-7614.g12b9659.el7.x86_64 14/25 2019-11-25T09:22:29.670 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:python-cephfs-15.0.0-7614.g12b9659.el7.x86_64 15/25 2019-11-25T09:22:29.988 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:libradosstriper1-15.0.0-7614.g12b9659.el7.x86_64 16/25 2019-11-25T09:22:30.299 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-11-25T09:22:30.604 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:python-ceph-common-15.0.0-7614.g12b9659.el7.x86_64 18/25 2019-11-25T09:22:33.104 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 19/25 2019-11-25T09:22:34.289 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 20/25 2019-11-25T09:22:34.868 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 21/25 2019-11-25T09:22:37.955 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-selinux-15.0.0-7614.g12b9659.el7.x86_64 22/25 2019-11-25T09:22:38.374 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 23/25 2019-11-25T09:22:38.633 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-25T09:22:38.955 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-25T09:22:39.062 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-selinux-15.0.0-7614.g12b9659.el7.x86_64 1/25 2019-11-25T09:22:39.163 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 2/25 2019-11-25T09:22:39.255 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:librados2-15.0.0-7614.g12b9659.el7.x86_64 3/25 2019-11-25T09:22:39.347 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 4/25 2019-11-25T09:22:39.481 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-rgw-15.0.0-7614.g12b9659.el7.x86_64 5/25 2019-11-25T09:22:39.591 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-cephfs-15.0.0-7614.g12b9659.el7.x86_64 6/25 2019-11-25T09:22:39.699 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-25T09:22:39.816 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 8/25 2019-11-25T09:22:39.942 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-rados-15.0.0-7614.g12b9659.el7.x86_64 9/25 2019-11-25T09:22:40.142 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 10/25 2019-11-25T09:22:40.251 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-rbd-15.0.0-7614.g12b9659.el7.x86_64 11/25 2019-11-25T09:22:40.356 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:libcephfs2-15.0.0-7614.g12b9659.el7.x86_64 12/25 2019-11-25T09:22:40.444 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-ceph-common-15.0.0-7614.g12b9659.el7.x86_64 13/25 2019-11-25T09:22:40.588 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 14/25 2019-11-25T09:22:40.686 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 15/25 2019-11-25T09:22:40.787 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 16/25 2019-11-25T09:22:40.871 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:librgw2-15.0.0-7614.g12b9659.el7.x86_64 17/25 2019-11-25T09:22:40.963 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7614.g12b9659.el7.x86_64 18/25 2019-11-25T09:22:41.047 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:libradosstriper1-15.0.0-7614.g12b9659.el7.x86_64 19/25 2019-11-25T09:22:41.172 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 20/25 2019-11-25T09:22:41.281 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-11-25T09:22:41.390 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:librbd1-15.0.0-7614.g12b9659.el7.x86_64 22/25 2019-11-25T09:22:41.516 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-11-25T09:22:41.517 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-25T09:22:41.916 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-25T09:22:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:41.917 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:22:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.917 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:41.918 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Installed: 2019-11-25T09:22:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.918 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-25T09:22:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-25T09:22:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.919 INFO:teuthology.orchestra.run.smithi174.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-25T09:22:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-25T09:22:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-25T09:22:41.920 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.921 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-25T09:22:41.921 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-argparse.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.921 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-common.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.921 INFO:teuthology.orchestra.run.smithi174.stdout: python-cephfs.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.922 INFO:teuthology.orchestra.run.smithi174.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-25T09:22:41.922 INFO:teuthology.orchestra.run.smithi174.stdout: python-rados.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.922 INFO:teuthology.orchestra.run.smithi174.stdout: python-rbd.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.922 INFO:teuthology.orchestra.run.smithi174.stdout: python-rgw.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.923 INFO:teuthology.orchestra.run.smithi174.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-25T09:22:41.923 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:41.923 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Updated: 2019-11-25T09:22:41.923 INFO:teuthology.orchestra.run.smithi174.stdout: librados2.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:41.924 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:41.924 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:22:42.041 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-test 2019-11-25T09:22:42.349 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:22:42.395 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:22:42.396 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:22:42.396 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:22:42.397 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:22:42.397 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:22:43.048 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:22:43.390 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:22:43.391 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:43.391 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-test.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:43.408 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:43.445 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:43.445 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:43.445 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:43.445 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-25T09:22:43.445 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-25T09:22:43.446 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-25T09:22:43.446 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-25T09:22:43.446 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:43.446 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-25T09:22:43.804 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:22:44.027 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:44.028 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:22:44.029 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:44.029 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:22:44.029 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository 2019-11-25T09:22:44.029 INFO:teuthology.orchestra.run.smithi174.stdout: Size 2019-11-25T09:22:44.030 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:22:44.030 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:22:44.030 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:15.0.0-7614.g12b9659.el7 ceph 38 M 2019-11-25T09:22:44.030 INFO:teuthology.orchestra.run.smithi174.stdout:Installing for dependencies: 2019-11-25T09:22:44.031 INFO:teuthology.orchestra.run.smithi174.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-25T09:22:44.031 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-25T09:22:44.031 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-25T09:22:44.031 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-25T09:22:44.032 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:44.032 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:22:44.032 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:22:44.032 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package (+4 Dependent packages) 2019-11-25T09:22:44.033 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:44.033 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 38 M 2019-11-25T09:22:44.033 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 134 M 2019-11-25T09:22:44.033 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:22:44.275 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-selinux-15.0.0-7614.g12b9659.el7.x86_64 22/25 2019-11-25T09:22:44.779 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 23/25 2019-11-25T09:22:45.070 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-25T09:22:45.423 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-25T09:22:45.542 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-selinux-15.0.0-7614.g12b9659.el7.x86_64 1/25 2019-11-25T09:22:45.676 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 2/25 2019-11-25T09:22:45.769 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:librados2-15.0.0-7614.g12b9659.el7.x86_64 3/25 2019-11-25T09:22:45.835 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:22:45.836 INFO:teuthology.orchestra.run.smithi174.stdout:Total 21 MB/s | 38 MB 00:01 2019-11-25T09:22:45.839 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:22:45.853 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 4/25 2019-11-25T09:22:45.867 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:22:45.933 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:22:45.934 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:22:46.004 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:python-rgw-15.0.0-7614.g12b9659.el7.x86_64 5/25 2019-11-25T09:22:46.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:python-cephfs-15.0.0-7614.g12b9659.el7.x86_64 6/25 2019-11-25T09:22:46.230 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 7/25 2019-11-25T09:22:46.381 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-base-15.0.0-7614.g12b9659.el7.x86_64 8/25 2019-11-25T09:22:46.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:python-rados-15.0.0-7614.g12b9659.el7.x86_64 9/25 2019-11-25T09:22:46.617 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-25T09:22:46.632 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-common-15.0.0-7614.g12b9659.el7.x86_64 10/25 2019-11-25T09:22:46.774 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:python-rbd-15.0.0-7614.g12b9659.el7.x86_64 11/25 2019-11-25T09:22:46.850 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:libcephfs2-15.0.0-7614.g12b9659.el7.x86_64 12/25 2019-11-25T09:22:46.920 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-25T09:22:46.934 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:python-ceph-common-15.0.0-7614.g12b9659.el7.x86_64 13/25 2019-11-25T09:22:47.026 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 14/25 2019-11-25T09:22:47.169 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 15/25 2019-11-25T09:22:47.207 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-25T09:22:47.271 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-radosgw-15.0.0-7614.g12b9659.el7.x86_64 16/25 2019-11-25T09:22:47.371 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:librgw2-15.0.0-7614.g12b9659.el7.x86_64 17/25 2019-11-25T09:22:47.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7614.g12b9659.el7.x86_64 18/25 2019-11-25T09:22:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:libradosstriper1-15.0.0-7614.g12b9659.el7.x86_64 19/25 2019-11-25T09:22:47.747 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 20/25 2019-11-25T09:22:47.873 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-11-25T09:22:47.976 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:librbd1-15.0.0-7614.g12b9659.el7.x86_64 22/25 2019-11-25T09:22:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 23/25 2019-11-25T09:22:48.087 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-11-25T09:22:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-11-25T09:22:48.407 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:48.407 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:22:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:48.408 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Installed: 2019-11-25T09:22:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.408 INFO:teuthology.orchestra.run.smithi135.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-11-25T09:22:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-11-25T09:22:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-11-25T09:22:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-11-25T09:22:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-11-25T09:22:48.409 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-11-25T09:22:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: python-ceph-argparse.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: python-ceph-common.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: python-cephfs.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-11-25T09:22:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: python-rados.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: python-rbd.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.410 INFO:teuthology.orchestra.run.smithi135.stdout: python-rgw.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-11-25T09:22:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:48.411 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Updated: 2019-11-25T09:22:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: librados2.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:48.411 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:48.411 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:22:48.528 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-test 2019-11-25T09:22:48.832 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:22:48.876 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:22:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:22:48.877 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:22:48.878 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:22:48.878 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:22:49.523 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:22:49.859 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:22:49.859 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:22:49.859 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-test.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:49.876 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:49.906 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:49.907 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:49.908 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:22:49.908 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-11-25T09:22:49.909 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-11-25T09:22:49.910 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-11-25T09:22:49.912 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-11-25T09:22:49.914 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:22:49.914 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-11-25T09:22:50.274 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:22:50.496 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:50.496 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:22:50.497 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:50.497 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:22:50.497 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository 2019-11-25T09:22:50.497 INFO:teuthology.orchestra.run.smithi135.stdout: Size 2019-11-25T09:22:50.497 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:22:50.497 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:22:50.497 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:15.0.0-7614.g12b9659.el7 ceph 38 M 2019-11-25T09:22:50.498 INFO:teuthology.orchestra.run.smithi135.stdout:Installing for dependencies: 2019-11-25T09:22:50.498 INFO:teuthology.orchestra.run.smithi135.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-11-25T09:22:50.498 INFO:teuthology.orchestra.run.smithi135.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-11-25T09:22:50.498 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-11-25T09:22:50.498 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-11-25T09:22:50.498 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:50.498 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:22:50.499 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:22:50.499 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package (+4 Dependent packages) 2019-11-25T09:22:50.499 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:50.499 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 38 M 2019-11-25T09:22:50.500 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 134 M 2019-11-25T09:22:50.500 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:22:51.251 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-25T09:22:51.999 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-test-15.0.0-7614.g12b9659.el7.x86_64 5/5 2019-11-25T09:22:52.123 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 1/5 2019-11-25T09:22:52.240 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-25T09:22:52.298 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:22:52.298 INFO:teuthology.orchestra.run.smithi135.stdout:Total 21 MB/s | 38 MB 00:01 2019-11-25T09:22:52.300 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:22:52.319 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:22:52.357 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : jq-1.5-1.el7.x86_64 3/5 2019-11-25T09:22:52.371 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:22:52.371 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:22:52.493 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 4/5 2019-11-25T09:22:52.993 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-test-15.0.0-7614.g12b9659.el7.x86_64 5/5 2019-11-25T09:22:52.993 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:52.993 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:22:52.993 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:52.993 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:52.994 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Installed: 2019-11-25T09:22:52.994 INFO:teuthology.orchestra.run.smithi174.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-25T09:22:52.994 INFO:teuthology.orchestra.run.smithi174.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-25T09:22:52.994 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:52.994 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:22:53.086 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-11-25T09:22:53.130 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph 2019-11-25T09:22:53.404 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:22:53.422 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-25T09:22:53.451 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:22:53.452 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:22:53.452 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:22:53.452 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:22:53.453 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:22:53.767 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-11-25T09:22:54.101 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:22:54.439 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:22:54.439 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:54.440 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:54.441 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:54.471 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:54.472 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:54.473 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:54.475 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:54.475 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:54.485 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:54.487 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:54.488 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:54.490 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:54.491 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:54.492 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:54.493 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:22:54.494 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:54.496 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:22:54.501 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:54.501 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-25T09:22:54.502 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-25T09:22:54.502 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-25T09:22:54.503 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-25T09:22:54.504 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-25T09:22:54.505 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-25T09:22:54.506 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-25T09:22:54.507 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-25T09:22:54.507 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-25T09:22:54.533 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-25T09:22:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-25T09:22:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-25T09:22:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-25T09:22:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:54.534 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-25T09:22:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-25T09:22:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-25T09:22:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-25T09:22:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-25T09:22:54.535 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-25T09:22:54.536 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-25T09:22:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-25T09:22:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-25T09:22:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-25T09:22:54.537 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-25T09:22:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-25T09:22:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-25T09:22:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-25T09:22:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:22:54.538 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-25T09:22:54.875 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:22:55.098 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:55.098 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:22:55.101 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:55.101 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:22:55.101 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository 2019-11-25T09:22:55.102 INFO:teuthology.orchestra.run.smithi174.stdout: Size 2019-11-25T09:22:55.102 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:22:55.102 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:22:55.102 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:15.0.0-7614.g12b9659.el7 ceph 2.0 k 2019-11-25T09:22:55.102 INFO:teuthology.orchestra.run.smithi174.stdout:Installing for dependencies: 2019-11-25T09:22:55.102 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:15.0.0-7614.g12b9659.el7 ceph 1.9 M 2019-11-25T09:22:55.102 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:15.0.0-7614.g12b9659.el7 ceph 1.7 M 2019-11-25T09:22:55.103 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:15.0.0-7614.g12b9659.el7 ceph 4.3 M 2019-11-25T09:22:55.103 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:15.0.0-7614.g12b9659.el7 ceph 16 M 2019-11-25T09:22:55.103 INFO:teuthology.orchestra.run.smithi174.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-25T09:22:55.103 INFO:teuthology.orchestra.run.smithi174.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-25T09:22:55.103 INFO:teuthology.orchestra.run.smithi174.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-25T09:22:55.103 INFO:teuthology.orchestra.run.smithi174.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-25T09:22:55.103 INFO:teuthology.orchestra.run.smithi174.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-25T09:22:55.104 INFO:teuthology.orchestra.run.smithi174.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-25T09:22:55.104 INFO:teuthology.orchestra.run.smithi174.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-25T09:22:55.104 INFO:teuthology.orchestra.run.smithi174.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-25T09:22:55.104 INFO:teuthology.orchestra.run.smithi174.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-25T09:22:55.104 INFO:teuthology.orchestra.run.smithi174.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-25T09:22:55.104 INFO:teuthology.orchestra.run.smithi174.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-25T09:22:55.104 INFO:teuthology.orchestra.run.smithi174.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-25T09:22:55.105 INFO:teuthology.orchestra.run.smithi174.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-25T09:22:55.105 INFO:teuthology.orchestra.run.smithi174.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-25T09:22:55.105 INFO:teuthology.orchestra.run.smithi174.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-25T09:22:55.105 INFO:teuthology.orchestra.run.smithi174.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-25T09:22:55.105 INFO:teuthology.orchestra.run.smithi174.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-25T09:22:55.105 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:55.105 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:22:55.106 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:22:55.106 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package (+21 Dependent packages) 2019-11-25T09:22:55.106 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:22:55.106 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 28 M 2019-11-25T09:22:55.107 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 87 M 2019-11-25T09:22:55.107 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:22:56.578 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:22:56.578 INFO:teuthology.orchestra.run.smithi174.stdout:Total 19 MB/s | 28 MB 00:01 2019-11-25T09:22:56.602 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:22:56.646 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:22:57.000 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:22:57.002 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:22:57.825 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-25T09:22:57.849 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-11-25T09:22:58.136 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-test-15.0.0-7614.g12b9659.el7.x86_64 5/5 2019-11-25T09:22:58.193 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-25T09:22:58.276 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 1/5 2019-11-25T09:22:58.385 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 2/5 2019-11-25T09:22:58.459 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-25T09:22:58.486 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jq-1.5-1.el7.x86_64 3/5 2019-11-25T09:22:58.636 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 4/5 2019-11-25T09:22:58.980 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 4/22 2019-11-25T09:22:59.121 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-test-15.0.0-7614.g12b9659.el7.x86_64 5/5 2019-11-25T09:22:59.122 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:59.122 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:22:59.122 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:22:59.122 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:59.122 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Installed: 2019-11-25T09:22:59.123 INFO:teuthology.orchestra.run.smithi135.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-11-25T09:22:59.123 INFO:teuthology.orchestra.run.smithi135.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-11-25T09:22:59.123 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:22:59.124 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:22:59.336 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 5/22 2019-11-25T09:22:59.699 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph 2019-11-25T09:22:59.740 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 6/22 2019-11-25T09:22:59.941 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:22:59.980 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:22:59.981 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:22:59.981 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:22:59.982 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:22:59.982 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:00.216 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 7/22 2019-11-25T09:23:00.519 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/22 2019-11-25T09:23:00.628 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:00.926 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 9/22 2019-11-25T09:23:00.956 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:23:00.956 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:00.957 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:00.958 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:00.988 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:00.989 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:00.990 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:01.007 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:01.008 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:01.008 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:01.010 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:01.010 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:01.013 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:01.017 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:01.018 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-11-25T09:23:01.018 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-11-25T09:23:01.019 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-11-25T09:23:01.020 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-25T09:23:01.021 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-25T09:23:01.022 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-25T09:23:01.023 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-11-25T09:23:01.023 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-11-25T09:23:01.024 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-11-25T09:23:01.025 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-11-25T09:23:01.026 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-11-25T09:23:01.026 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-11-25T09:23:01.026 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-11-25T09:23:01.027 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:01.027 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-11-25T09:23:01.028 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-11-25T09:23:01.028 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-11-25T09:23:01.029 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-11-25T09:23:01.029 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-11-25T09:23:01.029 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-11-25T09:23:01.030 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-11-25T09:23:01.031 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-11-25T09:23:01.031 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-11-25T09:23:01.031 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:01.031 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-11-25T09:23:01.031 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-11-25T09:23:01.032 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-11-25T09:23:01.032 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:01.032 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-11-25T09:23:01.032 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-11-25T09:23:01.033 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:01.033 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-11-25T09:23:01.256 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-mako-0.8.1-2.el7.noarch 10/22 2019-11-25T09:23:01.398 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:01.619 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:01.619 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:23:01.622 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:01.622 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:01.622 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository 2019-11-25T09:23:01.622 INFO:teuthology.orchestra.run.smithi135.stdout: Size 2019-11-25T09:23:01.623 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:01.623 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:23:01.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:15.0.0-7614.g12b9659.el7 ceph 2.0 k 2019-11-25T09:23:01.623 INFO:teuthology.orchestra.run.smithi135.stdout:Installing for dependencies: 2019-11-25T09:23:01.623 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:15.0.0-7614.g12b9659.el7 ceph 1.9 M 2019-11-25T09:23:01.624 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:15.0.0-7614.g12b9659.el7 ceph 1.7 M 2019-11-25T09:23:01.624 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:15.0.0-7614.g12b9659.el7 ceph 4.3 M 2019-11-25T09:23:01.624 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:15.0.0-7614.g12b9659.el7 ceph 16 M 2019-11-25T09:23:01.624 INFO:teuthology.orchestra.run.smithi135.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-11-25T09:23:01.625 INFO:teuthology.orchestra.run.smithi135.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-11-25T09:23:01.625 INFO:teuthology.orchestra.run.smithi135.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-11-25T09:23:01.625 INFO:teuthology.orchestra.run.smithi135.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-11-25T09:23:01.625 INFO:teuthology.orchestra.run.smithi135.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-11-25T09:23:01.625 INFO:teuthology.orchestra.run.smithi135.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-11-25T09:23:01.625 INFO:teuthology.orchestra.run.smithi135.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-11-25T09:23:01.626 INFO:teuthology.orchestra.run.smithi135.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-11-25T09:23:01.626 INFO:teuthology.orchestra.run.smithi135.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-11-25T09:23:01.626 INFO:teuthology.orchestra.run.smithi135.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-11-25T09:23:01.626 INFO:teuthology.orchestra.run.smithi135.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-11-25T09:23:01.626 INFO:teuthology.orchestra.run.smithi135.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-11-25T09:23:01.626 INFO:teuthology.orchestra.run.smithi135.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-11-25T09:23:01.627 INFO:teuthology.orchestra.run.smithi135.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-11-25T09:23:01.627 INFO:teuthology.orchestra.run.smithi135.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-11-25T09:23:01.627 INFO:teuthology.orchestra.run.smithi135.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-11-25T09:23:01.627 INFO:teuthology.orchestra.run.smithi135.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-11-25T09:23:01.627 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:01.627 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:23:01.628 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:01.628 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package (+21 Dependent packages) 2019-11-25T09:23:01.628 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:01.629 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 28 M 2019-11-25T09:23:01.629 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 87 M 2019-11-25T09:23:01.630 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:23:02.182 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-11-25T09:23:02.964 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:23:02.964 INFO:teuthology.orchestra.run.smithi135.stdout:Total 21 MB/s | 28 MB 00:01 2019-11-25T09:23:02.979 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:23:03.008 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:23:03.027 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mds-15.0.0-7614.g12b9659.el7.x86_64 12/22 2019-11-25T09:23:03.298 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:23:03.298 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:23:03.469 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mon-15.0.0-7614.g12b9659.el7.x86_64 13/22 2019-11-25T09:23:03.777 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-11-25T09:23:04.100 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-11-25T09:23:05.134 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-11-25T09:23:05.427 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-11-25T09:23:05.652 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-11-25T09:23:05.949 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 4/22 2019-11-25T09:23:06.031 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-osd-15.0.0-7614.g12b9659.el7.x86_64 16/22 2019-11-25T09:23:06.254 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-11-25T09:23:06.304 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 5/22 2019-11-25T09:23:06.487 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-11-25T09:23:06.723 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 6/22 2019-11-25T09:23:06.879 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-25T09:23:07.289 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 7/22 2019-11-25T09:23:07.588 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-25T09:23:07.635 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/22 2019-11-25T09:23:08.007 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 21/22 2019-11-25T09:23:08.054 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 9/22 2019-11-25T09:23:08.339 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 22/22 2019-11-25T09:23:08.381 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-mako-0.8.1-2.el7.noarch 10/22 2019-11-25T09:23:08.448 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-25T09:23:08.524 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-11-25T09:23:08.632 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-25T09:23:08.750 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-osd-15.0.0-7614.g12b9659.el7.x86_64 4/22 2019-11-25T09:23:08.875 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 5/22 2019-11-25T09:23:08.937 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-11-25T09:23:08.959 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 6/22 2019-11-25T09:23:09.043 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mon-15.0.0-7614.g12b9659.el7.x86_64 7/22 2019-11-25T09:23:09.135 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 8/22 2019-11-25T09:23:09.252 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 9/22 2019-11-25T09:23:09.377 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mds-15.0.0-7614.g12b9659.el7.x86_64 10/22 2019-11-25T09:23:09.528 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-11-25T09:23:09.630 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-11-25T09:23:09.729 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 13/22 2019-11-25T09:23:09.851 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-mds-15.0.0-7614.g12b9659.el7.x86_64 12/22 2019-11-25T09:23:09.854 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 14/22 2019-11-25T09:23:10.013 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 15/22 2019-11-25T09:23:10.130 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-11-25T09:23:10.247 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-25T09:23:10.298 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-mon-15.0.0-7614.g12b9659.el7.x86_64 13/22 2019-11-25T09:23:10.341 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-25T09:23:10.442 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-25T09:23:10.559 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-25T09:23:10.603 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-11-25T09:23:10.657 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 21/22 2019-11-25T09:23:11.154 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-11-25T09:23:11.154 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:11.155 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:23:11.155 INFO:teuthology.orchestra.run.smithi174.stdout: ceph.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:11.156 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:11.156 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Installed: 2019-11-25T09:23:11.156 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:11.156 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:11.157 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:11.157 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:11.157 INFO:teuthology.orchestra.run.smithi174.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-25T09:23:11.157 INFO:teuthology.orchestra.run.smithi174.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-25T09:23:11.158 INFO:teuthology.orchestra.run.smithi174.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-25T09:23:11.158 INFO:teuthology.orchestra.run.smithi174.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-25T09:23:11.158 INFO:teuthology.orchestra.run.smithi174.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-25T09:23:11.158 INFO:teuthology.orchestra.run.smithi174.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-25T09:23:11.158 INFO:teuthology.orchestra.run.smithi174.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-25T09:23:11.159 INFO:teuthology.orchestra.run.smithi174.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-25T09:23:11.159 INFO:teuthology.orchestra.run.smithi174.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-25T09:23:11.161 INFO:teuthology.orchestra.run.smithi174.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-25T09:23:11.162 INFO:teuthology.orchestra.run.smithi174.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-25T09:23:11.162 INFO:teuthology.orchestra.run.smithi174.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-25T09:23:11.162 INFO:teuthology.orchestra.run.smithi174.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-25T09:23:11.162 INFO:teuthology.orchestra.run.smithi174.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-25T09:23:11.163 INFO:teuthology.orchestra.run.smithi174.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-25T09:23:11.163 INFO:teuthology.orchestra.run.smithi174.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-25T09:23:11.163 INFO:teuthology.orchestra.run.smithi174.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-25T09:23:11.163 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:11.164 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:23:11.283 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-daemon 2019-11-25T09:23:11.574 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:11.613 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:11.614 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:11.614 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:11.614 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:11.614 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:12.250 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:12.536 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-11-25T09:23:12.575 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:23:12.576 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:12.576 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:12.930 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-osd-15.0.0-7614.g12b9659.el7.x86_64 16/22 2019-11-25T09:23:12.942 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:13.168 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:13.168 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:23:13.169 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:13.169 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:13.169 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository 2019-11-25T09:23:13.169 INFO:teuthology.orchestra.run.smithi174.stdout: Size 2019-11-25T09:23:13.169 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:13.170 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:23:13.170 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-daemon x86_64 2:15.0.0-7614.g12b9659.el7 ceph 17 k 2019-11-25T09:23:13.170 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:13.170 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:23:13.170 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:13.170 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2019-11-25T09:23:13.170 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:13.170 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 17 k 2019-11-25T09:23:13.171 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 66 k 2019-11-25T09:23:13.171 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:23:13.193 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-11-25T09:23:13.494 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:23:13.505 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:23:13.505 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:23:13.505 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:23:13.525 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-11-25T09:23:13.894 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-11-25T09:23:14.344 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-daemon-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:23:14.686 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-11-25T09:23:14.791 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-daemon-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:23:14.791 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:14.792 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:23:14.792 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-daemon.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:14.792 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:14.792 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:23:14.920 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr 2019-11-25T09:23:15.132 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 21/22 2019-11-25T09:23:15.206 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:15.252 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:15.253 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:15.254 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:15.254 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:15.255 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:15.455 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 22/22 2019-11-25T09:23:15.540 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-11-25T09:23:15.682 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-11-25T09:23:15.799 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-11-25T09:23:15.904 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:15.910 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-osd-15.0.0-7614.g12b9659.el7.x86_64 4/22 2019-11-25T09:23:16.059 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 5/22 2019-11-25T09:23:16.176 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 6/22 2019-11-25T09:23:16.249 INFO:teuthology.orchestra.run.smithi174.stdout:Package 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 already installed and latest version 2019-11-25T09:23:16.249 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do 2019-11-25T09:23:16.285 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-mon-15.0.0-7614.g12b9659.el7.x86_64 7/22 2019-11-25T09:23:16.311 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr-dashboard 2019-11-25T09:23:16.427 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 8/22 2019-11-25T09:23:16.472 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:16.506 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:16.506 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:16.507 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:16.507 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:16.508 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:16.544 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 9/22 2019-11-25T09:23:16.670 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-mds-15.0.0-7614.g12b9659.el7.x86_64 10/22 2019-11-25T09:23:16.804 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-11-25T09:23:16.880 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-11-25T09:23:16.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-15.0.0-7614.g12b9659.el7.x86_64 13/22 2019-11-25T09:23:17.047 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 14/22 2019-11-25T09:23:17.094 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:17.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 15/22 2019-11-25T09:23:17.290 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-11-25T09:23:17.399 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-11-25T09:23:17.418 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:23:17.418 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:17.418 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:17.421 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7614.g12b9659.el7.noarch 2019-11-25T09:23:17.450 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7614.g12b9659.el7.noarch 2019-11-25T09:23:17.451 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:17.452 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:17.452 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-25T09:23:17.452 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-25T09:23:17.454 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:17.454 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-25T09:23:17.525 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 18/22 2019-11-25T09:23:17.651 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 19/22 2019-11-25T09:23:17.759 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 20/22 2019-11-25T09:23:17.815 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:17.902 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 21/22 2019-11-25T09:23:18.041 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:18.041 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:23:18.042 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:18.042 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:18.042 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2019-11-25T09:23:18.042 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:18.042 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:23:18.042 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 3.8 M 2019-11-25T09:23:18.043 INFO:teuthology.orchestra.run.smithi174.stdout:Installing for dependencies: 2019-11-25T09:23:18.043 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 18 k 2019-11-25T09:23:18.043 INFO:teuthology.orchestra.run.smithi174.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-25T09:23:18.043 INFO:teuthology.orchestra.run.smithi174.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-25T09:23:18.043 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:18.043 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:23:18.043 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:18.044 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package (+3 Dependent packages) 2019-11-25T09:23:18.044 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:18.044 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 4.5 M 2019-11-25T09:23:18.044 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 19 M 2019-11-25T09:23:18.045 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:23:18.405 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-11-25T09:23:18.405 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:18.405 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:23:18.406 INFO:teuthology.orchestra.run.smithi135.stdout: ceph.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:18.406 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:18.406 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Installed: 2019-11-25T09:23:18.406 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:18.406 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:18.406 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:18.406 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:18.407 INFO:teuthology.orchestra.run.smithi135.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-11-25T09:23:18.407 INFO:teuthology.orchestra.run.smithi135.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-11-25T09:23:18.407 INFO:teuthology.orchestra.run.smithi135.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-11-25T09:23:18.407 INFO:teuthology.orchestra.run.smithi135.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-11-25T09:23:18.407 INFO:teuthology.orchestra.run.smithi135.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-11-25T09:23:18.407 INFO:teuthology.orchestra.run.smithi135.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-11-25T09:23:18.407 INFO:teuthology.orchestra.run.smithi135.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-11-25T09:23:18.407 INFO:teuthology.orchestra.run.smithi135.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-11-25T09:23:18.408 INFO:teuthology.orchestra.run.smithi135.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-11-25T09:23:18.408 INFO:teuthology.orchestra.run.smithi135.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-11-25T09:23:18.408 INFO:teuthology.orchestra.run.smithi135.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-11-25T09:23:18.408 INFO:teuthology.orchestra.run.smithi135.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-11-25T09:23:18.408 INFO:teuthology.orchestra.run.smithi135.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-11-25T09:23:18.408 INFO:teuthology.orchestra.run.smithi135.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-11-25T09:23:18.408 INFO:teuthology.orchestra.run.smithi135.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-11-25T09:23:18.409 INFO:teuthology.orchestra.run.smithi135.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-11-25T09:23:18.409 INFO:teuthology.orchestra.run.smithi135.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-11-25T09:23:18.409 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:18.409 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:23:18.524 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-daemon 2019-11-25T09:23:18.661 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:23:18.662 INFO:teuthology.orchestra.run.smithi174.stdout:Total 7.3 MB/s | 4.5 MB 00:00 2019-11-25T09:23:18.667 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:23:18.676 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:23:18.816 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:18.861 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:18.862 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:18.863 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:18.863 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:18.863 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:18.878 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:23:18.878 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:23:19.513 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:19.562 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7614.g12b9659.el7.noarch 1/4 2019-11-25T09:23:19.848 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:23:19.849 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:19.849 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:20.005 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-25T09:23:20.216 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:20.445 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:20.446 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:23:20.446 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:20.446 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:20.447 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository 2019-11-25T09:23:20.447 INFO:teuthology.orchestra.run.smithi135.stdout: Size 2019-11-25T09:23:20.447 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:20.447 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:23:20.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-daemon x86_64 2:15.0.0-7614.g12b9659.el7 ceph 17 k 2019-11-25T09:23:20.447 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:20.448 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:23:20.448 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:20.448 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2019-11-25T09:23:20.448 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:20.448 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 17 k 2019-11-25T09:23:20.448 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 66 k 2019-11-25T09:23:20.448 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:23:20.730 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:23:20.739 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:23:20.740 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:23:20.741 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:23:21.158 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-25T09:23:21.556 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-daemon-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:23:22.007 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-daemon-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:23:22.008 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:22.008 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:23:22.008 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-daemon.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:22.008 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:22.008 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:23:22.109 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr 2019-11-25T09:23:22.344 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:22.387 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:22.387 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:22.388 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:22.389 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:22.389 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:22.760 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7614.g12b9659.el7.noarch 4/4 2019-11-25T09:23:22.886 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-25T09:23:23.030 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-routes-1.13-2.el7.noarch 2/4 2019-11-25T09:23:23.033 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:23.171 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7614.g12b9659.el7.noarch 3/4 2019-11-25T09:23:23.365 INFO:teuthology.orchestra.run.smithi135.stdout:Package 2:ceph-mgr-15.0.0-7614.g12b9659.el7.x86_64 already installed and latest version 2019-11-25T09:23:23.365 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do 2019-11-25T09:23:23.427 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-dashboard 2019-11-25T09:23:23.614 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7614.g12b9659.el7.noarch 4/4 2019-11-25T09:23:23.615 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:23.615 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:23:23.615 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:23.615 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:23.615 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Installed: 2019-11-25T09:23:23.615 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:23.615 INFO:teuthology.orchestra.run.smithi174.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-25T09:23:23.616 INFO:teuthology.orchestra.run.smithi174.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-25T09:23:23.616 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:23.616 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:23:23.626 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:23.661 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:23.661 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:23.662 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:23.662 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:23.662 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:23.730 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-25T09:23:24.008 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:24.054 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:24.055 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:24.055 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:24.056 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:24.056 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:24.252 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:24.580 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:23:24.581 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:24.581 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:24.584 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7614.g12b9659.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7614.g12b9659.el7.noarch 2019-11-25T09:23:24.615 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7614.g12b9659.el7.noarch 2019-11-25T09:23:24.615 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:24.615 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:24.615 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-11-25T09:23:24.616 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-11-25T09:23:24.616 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:24.616 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-11-25T09:23:24.698 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:24.982 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:25.041 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:23:25.042 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:25.042 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:25.209 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:25.209 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:23:25.210 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:25.210 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:25.211 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2019-11-25T09:23:25.211 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:25.211 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:23:25.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 3.8 M 2019-11-25T09:23:25.211 INFO:teuthology.orchestra.run.smithi135.stdout:Installing for dependencies: 2019-11-25T09:23:25.211 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 18 k 2019-11-25T09:23:25.211 INFO:teuthology.orchestra.run.smithi135.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-11-25T09:23:25.212 INFO:teuthology.orchestra.run.smithi135.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-11-25T09:23:25.212 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:25.212 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:23:25.212 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:25.212 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package (+3 Dependent packages) 2019-11-25T09:23:25.212 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:25.212 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 4.5 M 2019-11-25T09:23:25.213 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 19 M 2019-11-25T09:23:25.213 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:23:25.407 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:25.635 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:25.635 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:23:25.636 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:25.636 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:25.636 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2019-11-25T09:23:25.636 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:25.636 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:23:25.636 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-cloud 2019-11-25T09:23:25.637 INFO:teuthology.orchestra.run.smithi174.stdout: noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 82 k 2019-11-25T09:23:25.637 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:25.637 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:23:25.637 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:25.637 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2019-11-25T09:23:25.637 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:25.637 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 82 k 2019-11-25T09:23:25.638 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 411 k 2019-11-25T09:23:25.638 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:23:25.828 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:23:25.828 INFO:teuthology.orchestra.run.smithi135.stdout:Total 7.3 MB/s | 4.5 MB 00:00 2019-11-25T09:23:25.834 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:23:25.845 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:23:25.991 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:23:25.994 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:23:26.025 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:23:26.025 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:23:26.046 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:23:26.046 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:23:26.679 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7614.g12b9659.el7.n 1/1 2019-11-25T09:23:26.700 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7614.g12b9659.el7.noarch 1/4 2019-11-25T09:23:27.195 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-11-25T09:23:27.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7614.g12b9659.el7.n 1/1 2019-11-25T09:23:27.226 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:27.226 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:23:27.226 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:27.226 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:27.226 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:23:27.355 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-25T09:23:27.590 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:27.634 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:27.635 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:27.636 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:27.636 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:27.636 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:28.287 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:28.349 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-11-25T09:23:28.623 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:23:28.623 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:28.624 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:28.627 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7614.g12b9659.el7.noarch 2019-11-25T09:23:28.656 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:28.656 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-25T09:23:28.662 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-25T09:23:28.663 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-25T09:23:28.666 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-25T09:23:28.666 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:28.666 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-25T09:23:28.667 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-25T09:23:28.668 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-25T09:23:28.669 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-25T09:23:28.670 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:28.670 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-25T09:23:28.790 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7614.g12b9659.el7.noarch 4/4 2019-11-25T09:23:28.950 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-11-25T09:23:29.037 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:29.092 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-routes-1.13-2.el7.noarch 2/4 2019-11-25T09:23:29.209 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7614.g12b9659.el7.noarch 3/4 2019-11-25T09:23:29.259 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:29.259 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:23:29.260 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:29.260 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:29.260 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2019-11-25T09:23:29.260 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:29.260 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:23:29.261 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local 2019-11-25T09:23:29.261 INFO:teuthology.orchestra.run.smithi174.stdout: noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 8.6 M 2019-11-25T09:23:29.261 INFO:teuthology.orchestra.run.smithi174.stdout:Installing for dependencies: 2019-11-25T09:23:29.261 INFO:teuthology.orchestra.run.smithi174.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-25T09:23:29.261 INFO:teuthology.orchestra.run.smithi174.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-25T09:23:29.261 INFO:teuthology.orchestra.run.smithi174.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-25T09:23:29.261 INFO:teuthology.orchestra.run.smithi174.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-25T09:23:29.261 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:29.262 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:23:29.262 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:29.262 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package (+4 Dependent packages) 2019-11-25T09:23:29.262 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:29.262 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 19 M 2019-11-25T09:23:29.262 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 104 M 2019-11-25T09:23:29.262 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:23:29.954 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:23:29.954 INFO:teuthology.orchestra.run.smithi174.stdout:Total 28 MB/s | 19 MB 00:00 2019-11-25T09:23:29.961 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:23:29.979 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:23:30.137 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:23:30.138 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:23:30.612 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7614.g12b9659.el7.noarch 4/4 2019-11-25T09:23:30.612 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:30.612 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:23:30.613 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:30.613 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:30.613 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Installed: 2019-11-25T09:23:30.613 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:30.613 INFO:teuthology.orchestra.run.smithi135.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-11-25T09:23:30.613 INFO:teuthology.orchestra.run.smithi135.stdout: python-routes.noarch 0:1.13-2.el7 2019-11-25T09:23:30.613 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:30.614 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:23:30.733 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-11-25T09:23:30.965 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:31.008 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:31.009 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:31.010 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:31.036 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-11-25T09:23:31.482 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-11-25T09:23:31.656 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:31.991 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:23:31.991 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:31.992 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:32.356 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:32.584 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:32.584 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:23:32.586 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:32.586 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:32.586 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2019-11-25T09:23:32.586 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:32.587 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:23:32.587 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-cloud 2019-11-25T09:23:32.587 INFO:teuthology.orchestra.run.smithi135.stdout: noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 82 k 2019-11-25T09:23:32.587 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:32.589 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:23:32.589 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:32.589 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2019-11-25T09:23:32.590 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:32.590 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 82 k 2019-11-25T09:23:32.590 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 411 k 2019-11-25T09:23:32.590 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:23:32.956 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:23:32.960 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:23:33.014 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:23:33.014 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:23:33.194 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-11-25T09:23:33.634 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7614.g12b9659.el7.n 1/1 2019-11-25T09:23:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7614.g12b9659.el7.n 1/1 2019-11-25T09:23:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:34.207 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:23:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:34.207 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:34.208 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:23:34.321 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-diskprediction-local 2019-11-25T09:23:34.554 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:34.593 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:34.594 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:34.595 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:34.595 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:34.820 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-25T09:23:35.151 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7614.g12b9659.el7.n 5/5 2019-11-25T09:23:35.232 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:35.256 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-25T09:23:35.405 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 2/5 2019-11-25T09:23:35.536 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7614.g12b9659.el7.n 3/5 2019-11-25T09:23:35.559 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:23:35.560 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:35.560 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:35.562 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7614.g12b9659.el7.noarch 2019-11-25T09:23:35.592 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:35.592 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-11-25T09:23:35.599 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-11-25T09:23:35.600 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-25T09:23:35.602 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-11-25T09:23:35.602 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:35.602 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-11-25T09:23:35.603 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-11-25T09:23:35.604 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-25T09:23:35.606 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-11-25T09:23:35.606 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:35.606 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-11-25T09:23:35.649 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-11-25T09:23:35.970 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:36.175 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-11-25T09:23:36.175 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:36.175 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:23:36.175 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:36.176 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:36.176 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Installed: 2019-11-25T09:23:36.176 INFO:teuthology.orchestra.run.smithi174.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-25T09:23:36.176 INFO:teuthology.orchestra.run.smithi174.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-25T09:23:36.176 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:36.176 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:23:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:36.199 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:23:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:36.200 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2019-11-25T09:23:36.200 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:36.200 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:23:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local 2019-11-25T09:23:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 8.6 M 2019-11-25T09:23:36.201 INFO:teuthology.orchestra.run.smithi135.stdout:Installing for dependencies: 2019-11-25T09:23:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-11-25T09:23:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-11-25T09:23:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-11-25T09:23:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-11-25T09:23:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:36.204 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:23:36.205 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:36.205 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package (+4 Dependent packages) 2019-11-25T09:23:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:36.205 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 19 M 2019-11-25T09:23:36.206 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 104 M 2019-11-25T09:23:36.206 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:23:36.295 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr-rook 2019-11-25T09:23:36.570 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:36.617 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:36.618 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:36.618 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:36.619 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:36.619 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:36.900 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:23:36.900 INFO:teuthology.orchestra.run.smithi135.stdout:Total 27 MB/s | 19 MB 00:00 2019-11-25T09:23:36.908 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:23:36.928 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:23:37.072 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:23:37.072 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:23:37.269 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:37.605 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:23:37.606 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:37.606 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:37.608 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7614.g12b9659.el7.noarch 2019-11-25T09:23:37.639 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:37.639 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-25T09:23:37.640 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-25T09:23:37.641 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-25T09:23:37.642 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-25T09:23:37.643 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-25T09:23:37.644 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:37.645 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-25T09:23:37.645 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-25T09:23:37.646 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-25T09:23:37.647 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-25T09:23:37.647 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-25T09:23:37.648 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-25T09:23:37.648 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-25T09:23:37.649 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-25T09:23:37.650 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:37.650 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-25T09:23:37.651 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-25T09:23:37.651 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-25T09:23:37.652 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-25T09:23:37.652 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-25T09:23:37.653 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:37.653 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-25T09:23:38.012 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-11-25T09:23:38.013 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:38.240 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:38.240 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:23:38.241 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:38.241 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:38.242 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2019-11-25T09:23:38.242 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:38.242 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:23:38.242 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 24 k 2019-11-25T09:23:38.242 INFO:teuthology.orchestra.run.smithi174.stdout:Installing for dependencies: 2019-11-25T09:23:38.242 INFO:teuthology.orchestra.run.smithi174.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-25T09:23:38.242 INFO:teuthology.orchestra.run.smithi174.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-25T09:23:38.243 INFO:teuthology.orchestra.run.smithi174.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-25T09:23:38.243 INFO:teuthology.orchestra.run.smithi174.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-25T09:23:38.243 INFO:teuthology.orchestra.run.smithi174.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-25T09:23:38.243 INFO:teuthology.orchestra.run.smithi174.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-25T09:23:38.243 INFO:teuthology.orchestra.run.smithi174.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-25T09:23:38.243 INFO:teuthology.orchestra.run.smithi174.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-25T09:23:38.243 INFO:teuthology.orchestra.run.smithi174.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-25T09:23:38.244 INFO:teuthology.orchestra.run.smithi174.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-25T09:23:38.244 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:38.244 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:23:38.244 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:38.244 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package (+10 Dependent packages) 2019-11-25T09:23:38.245 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:38.245 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 1.6 M 2019-11-25T09:23:38.245 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 24 M 2019-11-25T09:23:38.245 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:23:38.558 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-11-25T09:23:39.053 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:23:39.053 INFO:teuthology.orchestra.run.smithi174.stdout:Total 2.0 MB/s | 1.6 MB 00:00 2019-11-25T09:23:39.068 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:23:39.080 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:23:39.185 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:23:39.186 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:23:39.868 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 1/11 2019-11-25T09:23:40.141 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 2/11 2019-11-25T09:23:40.356 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-11-25T09:23:40.534 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 3/11 2019-11-25T09:23:40.860 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-11-25T09:23:41.216 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 5/11 2019-11-25T09:23:41.550 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 6/11 2019-11-25T09:23:41.874 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-25T09:23:42.029 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-11-25T09:23:42.212 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 8/11 2019-11-25T09:23:42.374 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7614.g12b9659.el7.n 5/5 2019-11-25T09:23:42.479 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-11-25T09:23:42.596 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 2/5 2019-11-25T09:23:42.738 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7614.g12b9659.el7.n 3/5 2019-11-25T09:23:42.855 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-11-25T09:23:43.358 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-11-25T09:23:43.358 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:43.358 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:23:43.358 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:43.358 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:43.359 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Installed: 2019-11-25T09:23:43.359 INFO:teuthology.orchestra.run.smithi135.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-11-25T09:23:43.359 INFO:teuthology.orchestra.run.smithi135.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-11-25T09:23:43.359 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:43.359 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:23:43.515 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-25T09:23:43.521 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-rook 2019-11-25T09:23:43.746 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:43.789 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:43.790 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:43.790 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:43.791 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:43.791 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:43.900 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-25T09:23:44.185 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7614.g12b9659.el7.noarch 11/11 2019-11-25T09:23:44.285 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-25T09:23:44.410 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 2/11 2019-11-25T09:23:44.435 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:44.494 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-11-25T09:23:44.595 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-11-25T09:23:44.686 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7614.g12b9659.el7.noarch 5/11 2019-11-25T09:23:44.767 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:23:44.768 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:44.768 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:44.770 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-11-25T09:23:44.770 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7614.g12b9659.el7.noarch 2019-11-25T09:23:44.800 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:44.800 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-11-25T09:23:44.803 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-25T09:23:44.804 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-25T09:23:44.805 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-25T09:23:44.806 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-11-25T09:23:44.807 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:44.807 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-11-25T09:23:44.807 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-11-25T09:23:44.808 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-11-25T09:23:44.809 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-25T09:23:44.809 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-25T09:23:44.810 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-11-25T09:23:44.811 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-11-25T09:23:44.811 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-11-25T09:23:44.812 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:44.813 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-11-25T09:23:44.813 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-11-25T09:23:44.814 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-11-25T09:23:44.814 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-11-25T09:23:44.815 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-11-25T09:23:44.815 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:44.815 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-11-25T09:23:44.853 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-11-25T09:23:44.990 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-11-25T09:23:45.105 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-11-25T09:23:45.179 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:45.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 10/11 2019-11-25T09:23:45.405 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:45.405 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:23:45.407 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:45.407 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:45.408 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2019-11-25T09:23:45.408 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:45.408 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:23:45.408 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 24 k 2019-11-25T09:23:45.408 INFO:teuthology.orchestra.run.smithi135.stdout:Installing for dependencies: 2019-11-25T09:23:45.408 INFO:teuthology.orchestra.run.smithi135.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-11-25T09:23:45.409 INFO:teuthology.orchestra.run.smithi135.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-11-25T09:23:45.409 INFO:teuthology.orchestra.run.smithi135.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-11-25T09:23:45.409 INFO:teuthology.orchestra.run.smithi135.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-11-25T09:23:45.409 INFO:teuthology.orchestra.run.smithi135.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-11-25T09:23:45.409 INFO:teuthology.orchestra.run.smithi135.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-11-25T09:23:45.409 INFO:teuthology.orchestra.run.smithi135.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-11-25T09:23:45.409 INFO:teuthology.orchestra.run.smithi135.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-11-25T09:23:45.409 INFO:teuthology.orchestra.run.smithi135.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-11-25T09:23:45.410 INFO:teuthology.orchestra.run.smithi135.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-11-25T09:23:45.410 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:45.410 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:23:45.410 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:45.410 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package (+10 Dependent packages) 2019-11-25T09:23:45.410 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:45.410 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 1.6 M 2019-11-25T09:23:45.411 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 24 M 2019-11-25T09:23:45.411 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:23:45.699 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 11/11 2019-11-25T09:23:45.699 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:45.699 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:23:45.699 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:45.699 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:45.699 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Installed: 2019-11-25T09:23:45.700 INFO:teuthology.orchestra.run.smithi174.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-25T09:23:45.700 INFO:teuthology.orchestra.run.smithi174.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-25T09:23:45.700 INFO:teuthology.orchestra.run.smithi174.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-25T09:23:45.700 INFO:teuthology.orchestra.run.smithi174.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-25T09:23:45.700 INFO:teuthology.orchestra.run.smithi174.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-25T09:23:45.700 INFO:teuthology.orchestra.run.smithi174.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-25T09:23:45.700 INFO:teuthology.orchestra.run.smithi174.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-25T09:23:45.701 INFO:teuthology.orchestra.run.smithi174.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-25T09:23:45.701 INFO:teuthology.orchestra.run.smithi174.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-25T09:23:45.701 INFO:teuthology.orchestra.run.smithi174.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-25T09:23:45.701 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:45.701 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:23:45.823 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-mgr-ssh 2019-11-25T09:23:46.088 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:46.115 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:23:46.116 INFO:teuthology.orchestra.run.smithi135.stdout:Total 2.3 MB/s | 1.6 MB 00:00 2019-11-25T09:23:46.129 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:23:46.133 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:46.134 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:46.135 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:46.140 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:23:46.241 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:23:46.242 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:23:46.788 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:46.942 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 1/11 2019-11-25T09:23:47.124 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:23:47.125 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:47.125 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:47.127 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7614.g12b9659.el7.noarch 2019-11-25T09:23:47.157 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:47.158 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-25T09:23:47.158 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-25T09:23:47.158 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:47.158 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-25T09:23:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 2/11 2019-11-25T09:23:47.530 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:47.732 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 3/11 2019-11-25T09:23:47.749 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:47.750 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:23:47.750 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:47.750 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:47.750 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2019-11-25T09:23:47.751 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:47.751 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:23:47.751 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-ssh noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 30 k 2019-11-25T09:23:47.751 INFO:teuthology.orchestra.run.smithi174.stdout:Installing for dependencies: 2019-11-25T09:23:47.752 INFO:teuthology.orchestra.run.smithi174.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-25T09:23:47.752 INFO:teuthology.orchestra.run.smithi174.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-25T09:23:47.752 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:47.753 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:23:47.753 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:47.753 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package (+2 Dependent packages) 2019-11-25T09:23:47.753 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:47.754 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 313 k 2019-11-25T09:23:47.754 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 1.1 M 2019-11-25T09:23:47.754 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:23:48.141 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-11-25T09:23:48.287 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:23:48.288 INFO:teuthology.orchestra.run.smithi174.stdout:Total 584 kB/s | 313 kB 00:00 2019-11-25T09:23:48.291 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:23:48.304 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:23:48.389 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:23:48.391 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:23:48.489 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 5/11 2019-11-25T09:23:48.858 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 6/11 2019-11-25T09:23:49.128 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-25T09:23:49.206 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-11-25T09:23:49.397 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-25T09:23:49.587 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 8/11 2019-11-25T09:23:49.659 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7614.g12b9659.el7.noarch 3/3 2019-11-25T09:23:49.762 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-25T09:23:49.887 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-25T09:23:50.406 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7614.g12b9659.el7.noarch 3/3 2019-11-25T09:23:50.406 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:50.406 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:23:50.406 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:50.407 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:50.407 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Installed: 2019-11-25T09:23:50.407 INFO:teuthology.orchestra.run.smithi174.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-25T09:23:50.407 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:50.407 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:23:50.542 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-fuse 2019-11-25T09:23:50.771 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:50.815 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:50.816 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:50.816 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:50.817 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:50.817 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:50.955 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-11-25T09:23:51.348 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-11-25T09:23:51.455 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:51.658 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7614.g12b9659.el7.noarch 11/11 2019-11-25T09:23:51.741 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-11-25T09:23:51.790 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:23:51.791 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:51.791 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:51.801 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:51.825 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 2/11 2019-11-25T09:23:51.834 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:51.834 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:51.835 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-25T09:23:51.835 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-25T09:23:51.837 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-25T09:23:51.839 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-25T09:23:51.840 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-25T09:23:51.840 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:23:51.840 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-25T09:23:51.846 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-25T09:23:51.846 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-25T09:23:51.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-11-25T09:23:52.043 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-11-25T09:23:52.152 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7614.g12b9659.el7.noarch 5/11 2019-11-25T09:23:52.213 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:52.285 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-11-25T09:23:52.386 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-11-25T09:23:52.439 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:52.439 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:23:52.440 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:52.440 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:52.440 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository 2019-11-25T09:23:52.440 INFO:teuthology.orchestra.run.smithi174.stdout: Size 2019-11-25T09:23:52.440 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:52.441 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:23:52.441 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:15.0.0-7614.g12b9659.el7 ceph 566 k 2019-11-25T09:23:52.441 INFO:teuthology.orchestra.run.smithi174.stdout:Installing for dependencies: 2019-11-25T09:23:52.441 INFO:teuthology.orchestra.run.smithi174.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-25T09:23:52.441 INFO:teuthology.orchestra.run.smithi174.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-25T09:23:52.441 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-25T09:23:52.442 INFO:teuthology.orchestra.run.smithi174.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-25T09:23:52.442 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:52.442 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:23:52.442 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:23:52.442 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package (+4 Dependent packages) 2019-11-25T09:23:52.442 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:52.443 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 10 M 2019-11-25T09:23:52.443 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 49 M 2019-11-25T09:23:52.443 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:23:52.528 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-11-25T09:23:52.679 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-11-25T09:23:52.804 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 10/11 2019-11-25T09:23:53.038 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:23:53.038 INFO:teuthology.orchestra.run.smithi174.stdout:Total 17 MB/s | 10 MB 00:00 2019-11-25T09:23:53.055 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:23:53.077 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:23:53.213 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:23:53.213 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:23:53.281 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 11/11 2019-11-25T09:23:53.282 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:53.282 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:23:53.282 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:53.282 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:53.282 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Installed: 2019-11-25T09:23:53.282 INFO:teuthology.orchestra.run.smithi135.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-11-25T09:23:53.282 INFO:teuthology.orchestra.run.smithi135.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-11-25T09:23:53.283 INFO:teuthology.orchestra.run.smithi135.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-11-25T09:23:53.283 INFO:teuthology.orchestra.run.smithi135.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-11-25T09:23:53.283 INFO:teuthology.orchestra.run.smithi135.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-11-25T09:23:53.283 INFO:teuthology.orchestra.run.smithi135.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-11-25T09:23:53.283 INFO:teuthology.orchestra.run.smithi135.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-11-25T09:23:53.283 INFO:teuthology.orchestra.run.smithi135.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-11-25T09:23:53.283 INFO:teuthology.orchestra.run.smithi135.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-11-25T09:23:53.284 INFO:teuthology.orchestra.run.smithi135.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-11-25T09:23:53.284 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:53.284 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:23:53.422 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-mgr-ssh 2019-11-25T09:23:53.664 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:53.706 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:53.708 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:53.708 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:53.708 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:53.709 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:54.290 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:54.616 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:23:54.617 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:54.617 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:54.620 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7614.g12b9659.el7.noarch 2019-11-25T09:23:54.649 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:54.649 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-11-25T09:23:54.650 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-11-25T09:23:54.650 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:54.651 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-11-25T09:23:55.017 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:23:55.242 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:55.242 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:23:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:55.243 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:55.243 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2019-11-25T09:23:55.244 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:55.244 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:23:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-ssh noarch 2:15.0.0-7614.g12b9659.el7 ceph-noarch 30 k 2019-11-25T09:23:55.245 INFO:teuthology.orchestra.run.smithi135.stdout:Installing for dependencies: 2019-11-25T09:23:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-11-25T09:23:55.245 INFO:teuthology.orchestra.run.smithi135.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-11-25T09:23:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:55.246 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:23:55.246 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:23:55.246 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package (+2 Dependent packages) 2019-11-25T09:23:55.246 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:55.246 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 313 k 2019-11-25T09:23:55.247 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 1.1 M 2019-11-25T09:23:55.247 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:23:55.402 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-11-25T09:23:55.776 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:23:55.776 INFO:teuthology.orchestra.run.smithi135.stdout:Total 588 kB/s | 313 kB 00:00 2019-11-25T09:23:55.781 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:23:55.789 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:23:55.866 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:23:55.866 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:23:55.927 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-11-25T09:23:56.658 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-11-25T09:23:56.746 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-11-25T09:23:56.955 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-11-25T09:23:57.215 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7614.g12b9659.el7.noarch 3/3 2019-11-25T09:23:57.225 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-25T09:23:57.361 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-11-25T09:23:57.495 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-11-25T09:23:57.783 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:ceph-fuse-15.0.0-7614.g12b9659.el7.x86_64 5/5 2019-11-25T09:23:57.898 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 1/5 2019-11-25T09:23:58.007 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:ceph-fuse-15.0.0-7614.g12b9659.el7.x86_64 2/5 2019-11-25T09:23:58.038 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7614.g12b9659.el7.noarch 3/3 2019-11-25T09:23:58.039 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:58.039 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:23:58.039 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:58.039 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:58.039 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Installed: 2019-11-25T09:23:58.039 INFO:teuthology.orchestra.run.smithi135.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-11-25T09:23:58.039 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:23:58.040 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:23:58.107 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-25T09:23:58.161 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-fuse 2019-11-25T09:23:58.196 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-25T09:23:58.362 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:58.402 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:58.403 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:58.404 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:58.643 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-11-25T09:23:58.643 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:58.643 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:23:58.643 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:23:58.643 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:58.643 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Installed: 2019-11-25T09:23:58.644 INFO:teuthology.orchestra.run.smithi174.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-25T09:23:58.644 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-25T09:23:58.644 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:23:58.644 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:23:58.767 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install libcephfs2 2019-11-25T09:23:59.000 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:23:59.040 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:23:59.041 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:23:59.042 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:23:59.042 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:23:59.042 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:23:59.050 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:59.375 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:23:59.375 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:59.376 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:23:59.386 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python36 for package: 2:ceph-fuse-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:59.418 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:23:59.419 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:59.419 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-11-25T09:23:59.419 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-11-25T09:23:59.422 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-11-25T09:23:59.422 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-11-25T09:23:59.423 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-11-25T09:23:59.424 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:23:59.424 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-11-25T09:23:59.430 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-11-25T09:23:59.430 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-11-25T09:23:59.683 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:23:59.793 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:24:00.008 INFO:teuthology.orchestra.run.smithi174.stdout:Package 2:libcephfs2-15.0.0-7614.g12b9659.el7.x86_64 already installed and latest version 2019-11-25T09:24:00.008 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do 2019-11-25T09:24:00.024 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:00.024 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:24:00.025 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:00.025 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:00.025 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository 2019-11-25T09:24:00.025 INFO:teuthology.orchestra.run.smithi135.stdout: Size 2019-11-25T09:24:00.026 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:00.026 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:24:00.026 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:15.0.0-7614.g12b9659.el7 ceph 566 k 2019-11-25T09:24:00.026 INFO:teuthology.orchestra.run.smithi135.stdout:Installing for dependencies: 2019-11-25T09:24:00.026 INFO:teuthology.orchestra.run.smithi135.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-11-25T09:24:00.026 INFO:teuthology.orchestra.run.smithi135.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-11-25T09:24:00.026 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-11-25T09:24:00.027 INFO:teuthology.orchestra.run.smithi135.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-11-25T09:24:00.027 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:00.027 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:24:00.027 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:00.027 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package (+4 Dependent packages) 2019-11-25T09:24:00.027 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:00.027 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 10 M 2019-11-25T09:24:00.028 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 49 M 2019-11-25T09:24:00.028 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:24:00.070 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install libcephfs-devel 2019-11-25T09:24:00.275 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:00.312 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:00.313 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:00.314 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:00.635 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:24:00.635 INFO:teuthology.orchestra.run.smithi135.stdout:Total 16 MB/s | 10 MB 00:00 2019-11-25T09:24:00.647 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:24:00.665 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:24:00.791 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:24:00.792 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:24:00.895 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:01.217 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:24:01.274 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:24:01.274 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:24:01.274 INFO:teuthology.orchestra.run.smithi174.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7614.g12b9659.el7 for package: 2:libcephfs-devel-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:24:01.275 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:24:01.275 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package librados-devel.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:24:01.623 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:24:01.850 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:01.850 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:24:01.851 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:01.851 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:24:01.851 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository 2019-11-25T09:24:01.851 INFO:teuthology.orchestra.run.smithi174.stdout: Size 2019-11-25T09:24:01.852 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:24:01.852 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:24:01.852 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:15.0.0-7614.g12b9659.el7 ceph 17 k 2019-11-25T09:24:01.852 INFO:teuthology.orchestra.run.smithi174.stdout:Installing for dependencies: 2019-11-25T09:24:01.852 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:15.0.0-7614.g12b9659.el7 ceph 93 k 2019-11-25T09:24:01.852 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:01.852 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:24:01.853 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:24:01.853 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package (+1 Dependent package) 2019-11-25T09:24:01.853 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:01.853 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 109 k 2019-11-25T09:24:01.853 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 398 k 2019-11-25T09:24:01.853 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:24:02.199 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:24:02.200 INFO:teuthology.orchestra.run.smithi174.stdout:Total 314 kB/s | 109 kB 00:00 2019-11-25T09:24:02.202 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:24:02.224 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:24:02.227 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:24:02.228 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:24:03.012 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-11-25T09:24:03.022 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:librados-devel-15.0.0-7614.g12b9659.el7.x86_64 1/2 2019-11-25T09:24:03.303 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:libcephfs-devel-15.0.0-7614.g12b9659.el7.x86_64 2/2 2019-11-25T09:24:03.535 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-11-25T09:24:03.616 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:librados-devel-15.0.0-7614.g12b9659.el7.x86_64 1/2 2019-11-25T09:24:03.915 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:libcephfs-devel-15.0.0-7614.g12b9659.el7.x86_64 2/2 2019-11-25T09:24:03.915 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:03.915 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:24:03.915 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:03.915 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:03.915 INFO:teuthology.orchestra.run.smithi174.stdout:Dependency Installed: 2019-11-25T09:24:03.916 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:03.916 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:03.916 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:24:04.034 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install librados2 2019-11-25T09:24:04.274 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:04.321 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:04.321 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:04.321 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:04.321 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:04.321 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:04.443 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-11-25T09:24:04.964 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:05.018 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-11-25T09:24:05.294 INFO:teuthology.orchestra.run.smithi174.stdout:Package 2:librados2-15.0.0-7614.g12b9659.el7.x86_64 already installed and latest version 2019-11-25T09:24:05.294 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do 2019-11-25T09:24:05.315 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:ceph-fuse-15.0.0-7614.g12b9659.el7.x86_64 5/5 2019-11-25T09:24:05.363 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install librbd1 2019-11-25T09:24:05.406 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 1/5 2019-11-25T09:24:05.498 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:ceph-fuse-15.0.0-7614.g12b9659.el7.x86_64 2/5 2019-11-25T09:24:05.596 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:05.638 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:05.639 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:05.639 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:05.640 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:05.641 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-11-25T09:24:05.641 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:05.732 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-11-25T09:24:06.225 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-11-25T09:24:06.225 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:06.225 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:24:06.225 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:06.225 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:06.226 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Installed: 2019-11-25T09:24:06.226 INFO:teuthology.orchestra.run.smithi135.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-11-25T09:24:06.226 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-11-25T09:24:06.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:06.226 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:24:06.287 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:06.342 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install libcephfs2 2019-11-25T09:24:06.611 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:06.622 INFO:teuthology.orchestra.run.smithi174.stdout:Package 2:librbd1-15.0.0-7614.g12b9659.el7.x86_64 already installed and latest version 2019-11-25T09:24:06.622 INFO:teuthology.orchestra.run.smithi174.stdout:Nothing to do 2019-11-25T09:24:06.656 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:06.658 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:06.658 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:06.659 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:06.659 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:06.683 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install python-ceph 2019-11-25T09:24:06.908 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:06.950 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:06.951 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:06.951 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:06.951 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:06.951 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:07.302 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:07.597 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:07.639 INFO:teuthology.orchestra.run.smithi135.stdout:Package 2:libcephfs2-15.0.0-7614.g12b9659.el7.x86_64 already installed and latest version 2019-11-25T09:24:07.639 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do 2019-11-25T09:24:07.701 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install libcephfs-devel 2019-11-25T09:24:07.929 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:24:07.929 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:24:07.929 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:24:07.931 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:07.973 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:07.974 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:07.975 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:07.975 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:07.975 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:08.298 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:24:08.525 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:08.526 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:24:08.526 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:08.527 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:24:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository 2019-11-25T09:24:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: Size 2019-11-25T09:24:08.527 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:24:08.527 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:24:08.527 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-compat x86_64 2:15.0.0-7614.g12b9659.el7 ceph 2.2 k 2019-11-25T09:24:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:08.528 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:24:08.528 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:24:08.528 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2019-11-25T09:24:08.528 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:08.528 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 2.2 k 2019-11-25T09:24:08.528 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 0 2019-11-25T09:24:08.529 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:24:08.610 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:08.788 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:24:08.789 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:24:08.791 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:24:08.792 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:24:08.945 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:24:08.946 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:24:08.946 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:24:08.947 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7614.g12b9659.el7 for package: 2:libcephfs-devel-15.0.0-7614.g12b9659.el7.x86_64 2019-11-25T09:24:08.977 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:24:08.977 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package librados-devel.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:24:09.287 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:python-ceph-compat-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:24:09.352 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:24:09.577 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:09.577 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:24:09.578 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:09.579 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:09.579 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository 2019-11-25T09:24:09.579 INFO:teuthology.orchestra.run.smithi135.stdout: Size 2019-11-25T09:24:09.579 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:09.579 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:24:09.579 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:15.0.0-7614.g12b9659.el7 ceph 17 k 2019-11-25T09:24:09.579 INFO:teuthology.orchestra.run.smithi135.stdout:Installing for dependencies: 2019-11-25T09:24:09.580 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:15.0.0-7614.g12b9659.el7 ceph 93 k 2019-11-25T09:24:09.580 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:09.580 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:24:09.580 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:09.580 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package (+1 Dependent package) 2019-11-25T09:24:09.580 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:09.580 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 109 k 2019-11-25T09:24:09.581 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 398 k 2019-11-25T09:24:09.581 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:24:09.803 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:python-ceph-compat-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:24:09.803 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:09.803 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:24:09.804 INFO:teuthology.orchestra.run.smithi174.stdout: python-ceph-compat.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:09.804 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:09.804 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:24:09.927 INFO:teuthology.orchestra.run.smithi174:> sudo yum -y install rbd-fuse 2019-11-25T09:24:09.937 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:24:09.937 INFO:teuthology.orchestra.run.smithi135.stdout:Total 305 kB/s | 109 kB 00:00 2019-11-25T09:24:09.939 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:24:09.958 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:24:09.960 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:24:09.961 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:24:10.175 INFO:teuthology.orchestra.run.smithi174.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:10.219 INFO:teuthology.orchestra.run.smithi174.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:10.220 INFO:teuthology.orchestra.run.smithi174.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:10.221 INFO:teuthology.orchestra.run.smithi174.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:10.221 INFO:teuthology.orchestra.run.smithi174.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:10.221 INFO:teuthology.orchestra.run.smithi174.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:10.805 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:librados-devel-15.0.0-7614.g12b9659.el7.x86_64 1/2 2019-11-25T09:24:10.862 INFO:teuthology.orchestra.run.smithi174.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:11.091 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:libcephfs-devel-15.0.0-7614.g12b9659.el7.x86_64 2/2 2019-11-25T09:24:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:librados-devel-15.0.0-7614.g12b9659.el7.x86_64 1/2 2019-11-25T09:24:11.196 INFO:teuthology.orchestra.run.smithi174.stdout:Resolving Dependencies 2019-11-25T09:24:11.197 INFO:teuthology.orchestra.run.smithi174.stdout:--> Running transaction check 2019-11-25T09:24:11.197 INFO:teuthology.orchestra.run.smithi174.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:24:11.571 INFO:teuthology.orchestra.run.smithi174.stdout:--> Finished Dependency Resolution 2019-11-25T09:24:11.631 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:libcephfs-devel-15.0.0-7614.g12b9659.el7.x86_64 2/2 2019-11-25T09:24:11.631 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:11.632 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:24:11.632 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:11.632 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:11.632 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Installed: 2019-11-25T09:24:11.633 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:11.633 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:11.633 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:24:11.745 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install librados2 2019-11-25T09:24:11.800 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:11.800 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies Resolved 2019-11-25T09:24:11.801 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:11.801 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:24:11.802 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2019-11-25T09:24:11.802 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:24:11.802 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2019-11-25T09:24:11.802 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:15.0.0-7614.g12b9659.el7 ceph 76 k 2019-11-25T09:24:11.803 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:11.803 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2019-11-25T09:24:11.803 INFO:teuthology.orchestra.run.smithi174.stdout:================================================================================ 2019-11-25T09:24:11.803 INFO:teuthology.orchestra.run.smithi174.stdout:Install 1 Package 2019-11-25T09:24:11.803 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:11.804 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 76 k 2019-11-25T09:24:11.804 INFO:teuthology.orchestra.run.smithi174.stdout:Installed size: 200 k 2019-11-25T09:24:11.804 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading packages: 2019-11-25T09:24:12.014 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:12.059 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:12.060 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:12.060 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:12.060 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:12.061 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:12.129 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2019-11-25T09:24:12.151 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2019-11-25T09:24:12.152 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded 2019-11-25T09:24:12.152 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2019-11-25T09:24:12.699 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:12.841 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : 2:rbd-fuse-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:24:13.035 INFO:teuthology.orchestra.run.smithi135.stdout:Package 2:librados2-15.0.0-7614.g12b9659.el7.x86_64 already installed and latest version 2019-11-25T09:24:13.036 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do 2019-11-25T09:24:13.096 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install librbd1 2019-11-25T09:24:13.241 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : 2:rbd-fuse-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:24:13.241 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:13.241 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2019-11-25T09:24:13.242 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:13.242 INFO:teuthology.orchestra.run.smithi174.stdout: 2019-11-25T09:24:13.242 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2019-11-25T09:24:13.262 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:13.296 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:13.297 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:13.297 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:13.297 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:13.298 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:13.361 DEBUG:teuthology.parallel:result is None 2019-11-25T09:24:13.879 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:14.204 INFO:teuthology.orchestra.run.smithi135.stdout:Package 2:librbd1-15.0.0-7614.g12b9659.el7.x86_64 already installed and latest version 2019-11-25T09:24:14.205 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do 2019-11-25T09:24:14.266 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install python-ceph 2019-11-25T09:24:14.430 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:14.464 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:14.465 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:14.465 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:14.465 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:14.466 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:15.049 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:15.375 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:24:15.376 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:24:15.376 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:24:15.756 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:24:15.985 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:15.986 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:24:15.987 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:15.987 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:15.987 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository 2019-11-25T09:24:15.987 INFO:teuthology.orchestra.run.smithi135.stdout: Size 2019-11-25T09:24:15.988 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:15.988 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:24:15.988 INFO:teuthology.orchestra.run.smithi135.stdout: python-ceph-compat x86_64 2:15.0.0-7614.g12b9659.el7 ceph 2.2 k 2019-11-25T09:24:15.988 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:15.989 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:24:15.989 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:15.989 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2019-11-25T09:24:15.989 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:15.989 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 2.2 k 2019-11-25T09:24:15.990 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 0 2019-11-25T09:24:15.990 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:24:16.275 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:24:16.277 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:24:16.279 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:24:16.280 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:24:16.846 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:python-ceph-compat-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:24:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:python-ceph-compat-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:24:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:17.378 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:24:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: python-ceph-compat.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:17.378 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:17.379 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:24:17.492 INFO:teuthology.orchestra.run.smithi135:> sudo yum -y install rbd-fuse 2019-11-25T09:24:17.742 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:24:17.783 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:24:17.784 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:24:17.784 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:24:17.784 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:24:17.785 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:24:18.429 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:24:18.759 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:24:18.760 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:24:18.760 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7614.g12b9659.el7 will be installed 2019-11-25T09:24:19.139 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:24:19.369 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:19.370 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:24:19.370 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:19.370 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:19.371 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2019-11-25T09:24:19.371 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:19.371 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:24:19.371 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:15.0.0-7614.g12b9659.el7 ceph 76 k 2019-11-25T09:24:19.371 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:19.371 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:24:19.372 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:24:19.372 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2019-11-25T09:24:19.372 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:19.372 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 76 k 2019-11-25T09:24:19.372 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 200 k 2019-11-25T09:24:19.372 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:24:19.702 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:24:19.724 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:24:19.725 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:24:19.726 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:24:20.342 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : 2:rbd-fuse-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:24:20.897 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : 2:rbd-fuse-15.0.0-7614.g12b9659.el7.x86_64 1/1 2019-11-25T09:24:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:20.898 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:24:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse.x86_64 2:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:20.898 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:24:20.898 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:24:21.021 DEBUG:teuthology.parallel:result is None 2019-11-25T09:24:21.022 INFO:teuthology.orchestra.run.smithi174:> sudo lsb_release -is 2019-11-25T09:24:21.178 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS 2019-11-25T09:24:21.179 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-25T09:24:21.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=12b9659be24ae0e3d791f80d81504ab2770c1343 2019-11-25T09:24:21.340 INFO:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-25T09:24:21.473 INFO:teuthology.orchestra.run.smithi174.stdout:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:21.474 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7614.g12b9659.el7 2019-11-25T09:24:21.474 INFO:teuthology.task.install:The correct ceph version 15.0.0-7614.g12b9659 is installed. 2019-11-25T09:24:21.475 INFO:teuthology.orchestra.run.smithi135:> sudo lsb_release -is 2019-11-25T09:24:21.633 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS 2019-11-25T09:24:21.634 DEBUG:teuthology.misc:System to be installed: CentOS 2019-11-25T09:24:21.634 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=12b9659be24ae0e3d791f80d81504ab2770c1343 2019-11-25T09:24:21.823 INFO:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-11-25T09:24:21.956 INFO:teuthology.orchestra.run.smithi135.stdout:15.0.0-7614.g12b9659.el7 2019-11-25T09:24:21.956 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7614.g12b9659.el7 2019-11-25T09:24:21.957 INFO:teuthology.task.install:The correct ceph version 15.0.0-7614.g12b9659 is installed. 2019-11-25T09:24:21.957 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-11-25T09:24:21.957 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-25T09:24:22.076 INFO:teuthology.orchestra.run.smithi135:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-11-25T09:24:22.201 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-11-25T09:24:22.201 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-25T09:24:22.325 INFO:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-25T09:24:22.431 INFO:teuthology.orchestra.run.smithi135:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-11-25T09:24:22.550 INFO:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-11-25T09:24:22.665 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-11-25T09:24:22.665 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-25T09:24:22.793 INFO:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-25T09:24:22.915 INFO:teuthology.orchestra.run.smithi135:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-11-25T09:24:23.037 INFO:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-11-25T09:24:23.137 INFO:teuthology.run_tasks:Running task ceph... 2019-11-25T09:24:23.200 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-11-25T09:24:23.201 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2019-11-25T09:24:23.205 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2019-11-25T09:24:23.325 INFO:tasks.ceph:Disabling ceph logrotate... 2019-11-25T09:24:23.326 INFO:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-25T09:24:23.331 INFO:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2019-11-25T09:24:23.434 INFO:tasks.ceph:Creating extra log directories... 2019-11-25T09:24:23.435 INFO:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-25T09:24:23.439 INFO:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-11-25T09:24:23.527 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-11-25T09:24:23.527 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'debug ms': 1, 'debug journal': 20, 'osd shutdown pgref assert': True, 'debug osd': 25, 'debug filestore': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}} 2019-11-25T09:24:23.527 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'flavor': 'notcmalloc', 'sha1': '12b9659be24ae0e3d791f80d81504ab2770c1343'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}, {'swift': {'client.0': {'rgw_server': 'client.0'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-add-kafka-security2/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.9243', 'owner': 'scheduled_yuvalif@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi135.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDW1IhJLIpt7+JzxO/Pejcae9ZACyO0PfqO8jzr+foHSgViAiaoVyibr/dLiWXAQOW3D1QypMDAQ2GeWGIqx6eUaTduwZr4pccohCUbPsjoj1C8c8CDA8v67cNWiaZ242+j6cHhJxMc3V62cPiXsETR/QZ/5NEoMIyskxsTMcBXQCWl7vXG78jIOmNzHKE8MxPsbJNeUzURzUQTiU7MJ2vRCoDp/qMF0cUcmFs9yT3n81T7FsTz2fiyIOzlGFWTRyK22465HPPR+5gBTAFgfiHQRWD09yW76xJtTZQEs2HrcYNrfvFL+Xq5v2QGtnR5zHDiVeFUgNvqlqVJvx4t97DL', 'smithi174.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYWtHFbSToIn0xynJX+mC3n82/ROM8vgE9TBXtsuPFJ2HeBbusDqAUxSP6032zAz/60pFHf83FEJsEKvwfCxVqkVKVUt7IfUkQLPGBzLnrKmeqb+vri/FbiFTW+Tyoj95W/NDwA8WpYTwQ1x9VcW+gBesWIDEJ/CbjunG4yl4RHe3yDpyF6LDcX+w7Dly6j+DLSqjZdH2gKqo3Qt2l+SfCfd04Z/svxdV8Vu7+GbaV9NYMAOzVrUwH/7xXxFFqbukPJ320iVZoVemiCTj9qeNX83u5uazlupW7RevGPTZitNnpAfADFxNac7qpso7hHwGKe0/cm011YkAxoLIHgG2p'}, 'job_id': '4542043', 'tube': 'smithi', 'suite_branch': 'wip-yuval-add-kafka-security2', 'priority': 100, 'first_in_suite': False, 'branch': 'wip-yuval-add-kafka-security2', 'suite': 'rgw:verify', 'email': 'yuvalif@yahoo.com', 'archive_path': '/home/teuthworker/archive/yuvalif-2019-11-25_06:14:24-rgw:verify-wip-yuval-add-kafka-security2-distro-basic-smithi/4542043', 'description': 'rgw:verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '12b9659be24ae0e3d791f80d81504ab2770c1343', 'name': 'yuvalif-2019-11-25_06:14:24-rgw:verify-wip-yuval-add-kafka-security2-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '12b9659be24ae0e3d791f80d81504ab2770c1343', 'os_type': 'centos', 'overrides': {'ceph': {'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'debug ms': 1, 'debug journal': 20, 'osd shutdown pgref assert': True, 'debug osd': 25, 'debug filestore': 20, 'osd objectstore': 'filestore', 'osd sloppy crc': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'sha1': '12b9659be24ae0e3d791f80d81504ab2770c1343'}, 's3tests': {'slow_backend': True}, 'ceph-deploy': {'fs': 'xfs', 'filestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd sloppy crc': True, 'osd objectstore': 'filestore'}}}, 'install': {'ceph': {'flavor': 'notcmalloc', 'sha1': '12b9659be24ae0e3d791f80d81504ab2770c1343'}}, 'rgw': {'frontend': 'civetweb', 'compression type': 'random', 'storage classes': 'LUKEWARM, FROZEN', 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'ec-data-pool': True}, 'admin_socket': {'branch': 'wip-yuval-add-kafka-security2'}, 'workunit': {'sha1': '12b9659be24ae0e3d791f80d81504ab2770c1343', 'branch': 'wip-yuval-add-kafka-security2'}}} 2019-11-25T09:24:23.528 INFO:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-25T09:24:23.533 INFO:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-11-25T09:24:23.610 INFO:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2019-11-25T09:24:23.615 INFO:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2019-11-25T09:24:23.791 DEBUG:teuthology.orchestra.remote:smithi174:/scratch_devs is 72B 2019-11-25T09:24:23.904 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-25T09:24:23.950 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-25T09:24:24.039 INFO:teuthology.orchestra.run.smithi174.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-25T09:24:24.040 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-25T09:24:24.040 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 101890 Links: 1 2019-11-25T09:24:24.040 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-25T09:24:24.040 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2019-11-25T09:24:24.042 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2019-11-25 09:23:07.888336829 +0000 2019-11-25T09:24:24.043 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2019-11-25 09:21:22.462318313 +0000 2019-11-25T09:24:24.043 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2019-11-25 09:21:22.462318313 +0000 2019-11-25T09:24:24.043 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2019-11-25T09:24:24.071 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2019-11-25T09:24:24.071 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2019-11-25T09:24:24.071 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes (512 B) copied, 0.000369121 s, 1.4 MB/s 2019-11-25T09:24:24.076 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-25T09:24:24.154 INFO:teuthology.orchestra.run.smithi174.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-25T09:24:24.154 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-25T09:24:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 109660 Links: 1 2019-11-25T09:24:24.154 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-25T09:24:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2019-11-25T09:24:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2019-11-25 09:23:07.888336829 +0000 2019-11-25T09:24:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2019-11-25 09:21:22.884312341 +0000 2019-11-25T09:24:24.155 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2019-11-25 09:21:22.884312341 +0000 2019-11-25T09:24:24.155 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2019-11-25T09:24:24.181 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2019-11-25T09:24:24.181 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2019-11-25T09:24:24.181 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes (512 B) copied, 0.000442721 s, 1.2 MB/s 2019-11-25T09:24:24.185 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-25T09:24:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-25T09:24:24.248 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-25T09:24:24.248 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 102775 Links: 1 2019-11-25T09:24:24.248 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-25T09:24:24.248 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2019-11-25T09:24:24.248 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2019-11-25 09:23:07.888336829 +0000 2019-11-25T09:24:24.249 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2019-11-25 09:21:23.364305549 +0000 2019-11-25T09:24:24.249 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2019-11-25 09:21:23.364305549 +0000 2019-11-25T09:24:24.249 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2019-11-25T09:24:24.269 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2019-11-25T09:24:24.270 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2019-11-25T09:24:24.270 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes (512 B) copied, 0.000322307 s, 1.6 MB/s 2019-11-25T09:24:24.273 INFO:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-25T09:24:24.343 INFO:teuthology.orchestra.run.smithi174.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-25T09:24:24.343 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-25T09:24:24.344 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 109706 Links: 1 2019-11-25T09:24:24.344 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-25T09:24:24.344 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2019-11-25T09:24:24.344 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2019-11-25 09:23:07.888336829 +0000 2019-11-25T09:24:24.344 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2019-11-25 09:21:23.817299138 +0000 2019-11-25T09:24:24.345 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2019-11-25 09:21:23.817299138 +0000 2019-11-25T09:24:24.345 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: - 2019-11-25T09:24:24.353 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2019-11-25T09:24:24.353 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2019-11-25T09:24:24.353 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes (512 B) copied, 0.000348957 s, 1.5 MB/s 2019-11-25T09:24:24.356 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-25T09:24:24.356 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-25T09:24:24.357 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-25T09:24:24.357 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-25T09:24:24.455 DEBUG:teuthology.orchestra.remote:smithi135:/scratch_devs is 72B 2019-11-25T09:24:24.536 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-25T09:24:24.537 INFO:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-11-25T09:24:24.618 INFO:teuthology.orchestra.run.smithi135.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-11-25T09:24:24.618 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-25T09:24:24.618 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 89046 Links: 1 2019-11-25T09:24:24.619 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-25T09:24:24.619 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2019-11-25T09:24:24.619 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2019-11-25 09:23:15.016944009 +0000 2019-11-25T09:24:24.619 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2019-11-25 09:21:22.456045600 +0000 2019-11-25T09:24:24.619 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2019-11-25 09:21:22.456045600 +0000 2019-11-25T09:24:24.619 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2019-11-25T09:24:24.645 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2019-11-25T09:24:24.645 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2019-11-25T09:24:24.645 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes (512 B) copied, 0.000359646 s, 1.4 MB/s 2019-11-25T09:24:24.650 INFO:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-11-25T09:24:24.715 INFO:teuthology.orchestra.run.smithi135.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-11-25T09:24:24.716 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-25T09:24:24.716 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 100900 Links: 1 2019-11-25T09:24:24.716 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-25T09:24:24.716 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2019-11-25T09:24:24.716 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2019-11-25 09:23:15.016944009 +0000 2019-11-25T09:24:24.717 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2019-11-25 09:21:22.949034141 +0000 2019-11-25T09:24:24.717 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2019-11-25 09:21:22.949034141 +0000 2019-11-25T09:24:24.717 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2019-11-25T09:24:24.736 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2019-11-25T09:24:24.736 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2019-11-25T09:24:24.736 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes (512 B) copied, 0.000376174 s, 1.4 MB/s 2019-11-25T09:24:24.741 INFO:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-11-25T09:24:24.796 INFO:teuthology.orchestra.run.smithi135.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-11-25T09:24:24.796 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-25T09:24:24.796 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 106101 Links: 1 2019-11-25T09:24:24.797 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-25T09:24:24.797 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2019-11-25T09:24:24.797 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2019-11-25 09:23:15.016944009 +0000 2019-11-25T09:24:24.797 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2019-11-25 09:21:23.444022634 +0000 2019-11-25T09:24:24.797 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2019-11-25 09:21:23.444022634 +0000 2019-11-25T09:24:24.798 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2019-11-25T09:24:24.813 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2019-11-25T09:24:24.814 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2019-11-25T09:24:24.814 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes (512 B) copied, 0.0003073 s, 1.7 MB/s 2019-11-25T09:24:24.818 INFO:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-11-25T09:24:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-11-25T09:24:24.869 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-11-25T09:24:24.870 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 109006 Links: 1 2019-11-25T09:24:24.870 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-11-25T09:24:24.870 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2019-11-25T09:24:24.870 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2019-11-25 09:23:15.017943909 +0000 2019-11-25T09:24:24.872 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2019-11-25 09:21:23.906011896 +0000 2019-11-25T09:24:24.872 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2019-11-25 09:21:23.906011896 +0000 2019-11-25T09:24:24.872 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: - 2019-11-25T09:24:24.883 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2019-11-25T09:24:24.883 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2019-11-25T09:24:24.883 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes (512 B) copied, 0.000307963 s, 1.7 MB/s 2019-11-25T09:24:24.886 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-11-25T09:24:24.886 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-11-25T09:24:24.886 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-11-25T09:24:24.886 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-25T09:24:24.887 INFO:tasks.ceph:Generating config... 2019-11-25T09:24:24.888 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2019-11-25T09:24:24.888 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-11-25T09:24:24.889 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2019-11-25T09:24:24.889 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-11-25T09:24:24.889 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2019-11-25T09:24:24.889 INFO:tasks.ceph:[osd] debug ms = 1 2019-11-25T09:24:24.890 INFO:tasks.ceph:[osd] debug journal = 20 2019-11-25T09:24:24.890 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-11-25T09:24:24.891 INFO:tasks.ceph:[osd] debug osd = 25 2019-11-25T09:24:24.891 INFO:tasks.ceph:[osd] debug filestore = 20 2019-11-25T09:24:24.891 INFO:tasks.ceph:[osd] osd objectstore = filestore 2019-11-25T09:24:24.891 INFO:tasks.ceph:[osd] osd sloppy crc = True 2019-11-25T09:24:24.891 INFO:tasks.ceph:[mon] debug mon = 20 2019-11-25T09:24:24.891 INFO:tasks.ceph:[mon] debug paxos = 20 2019-11-25T09:24:24.891 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2019-11-25T09:24:24.892 INFO:tasks.ceph:[mon] debug ms = 1 2019-11-25T09:24:24.892 INFO:tasks.ceph:[client] debug rgw = 20 2019-11-25T09:24:24.892 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2019-11-25T09:24:24.892 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2019-11-25T09:24:24.892 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2019-11-25T09:24:24.892 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2019-11-25T09:24:24.893 INFO:tasks.ceph:Setting up mon.a... 2019-11-25T09:24:24.893 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-11-25T09:24:25.045 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.keyring 2019-11-25T09:24:25.049 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-11-25T09:24:25.183 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-25T09:24:25.297 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.135'), ('mon.c', '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]'), ('mon.b', '172.21.15.174')] 2019-11-25T09:24:25.297 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.135 --addv c '[v2:172.21.15.135:3301,v1:172.21.15.135:6790]' --add b 172.21.15.174 --print /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:25.442 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:25.442 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: generated fsid 577fddeb-3e3f-44bf-adf0-3d64c0d28517 2019-11-25T09:24:25.442 INFO:teuthology.orchestra.run.smithi135.stdout:epoch 0 2019-11-25T09:24:25.442 INFO:teuthology.orchestra.run.smithi135.stdout:fsid 577fddeb-3e3f-44bf-adf0-3d64c0d28517 2019-11-25T09:24:25.442 INFO:teuthology.orchestra.run.smithi135.stdout:last_changed 2019-11-25T09:24:25.429418+0000 2019-11-25T09:24:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:created 2019-11-25T09:24:25.429418+0000 2019-11-25T09:24:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:min_mon_release 0 (unknown) 2019-11-25T09:24:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2019-11-25T09:24:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.b 2019-11-25T09:24:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:2: [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] mon.c 2019-11-25T09:24:25.443 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-11-25T09:24:25.444 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 577fddeb-3e3f-44bf-adf0-3d64c0d28517... 2019-11-25T09:24:25.445 INFO:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-25T09:24:25.453 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-11-25T09:24:25.659 INFO:tasks.ceph:Creating admin key on mon.a... 2019-11-25T09:24:25.660 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-11-25T09:24:25.826 INFO:tasks.ceph:Copying monmap to all nodes... 2019-11-25T09:24:25.921 DEBUG:teuthology.orchestra.remote:smithi135:/etc/ceph/ceph.keyring is 206B 2019-11-25T09:24:26.076 DEBUG:teuthology.orchestra.remote:smithi135:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-11-25T09:24:26.152 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:24:26.152 INFO:teuthology.orchestra.run.smithi174:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-25T09:24:26.297 INFO:teuthology.orchestra.run.smithi174:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:26.372 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:24:26.372 INFO:teuthology.orchestra.run.smithi135:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-11-25T09:24:26.507 INFO:teuthology.orchestra.run.smithi135:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:26.575 INFO:tasks.ceph:Setting up mon nodes... 2019-11-25T09:24:26.575 INFO:tasks.ceph:Setting up mgr nodes... 2019-11-25T09:24:26.575 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-11-25T09:24:26.789 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-11-25T09:24:26.794 INFO:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-11-25T09:24:26.954 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-11-25T09:24:26.958 INFO:tasks.ceph:Setting up mds nodes... 2019-11-25T09:24:26.958 INFO:tasks.ceph_client:Setting up client nodes... 2019-11-25T09:24:26.958 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-11-25T09:24:27.099 INFO:teuthology.orchestra.run.smithi174.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-11-25T09:24:27.129 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-11-25T09:24:27.264 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-11-25T09:24:27.292 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-11-25T09:24:27.292 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}} 2019-11-25T09:24:27.292 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-11-25T09:24:27.411 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-25T09:24:27.411 INFO:tasks.ceph:{} 2019-11-25T09:24:27.411 INFO:tasks.ceph:osd.4 2019-11-25T09:24:27.411 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:24:27.411 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-25T09:24:28.005 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-25T09:24:28.005 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-25T09:24:28.005 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=0, sparse=0 2019-11-25T09:24:28.005 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-25T09:24:28.006 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2019-11-25T09:24:28.006 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-25T09:24:28.006 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-25T09:24:28.006 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-25T09:24:28.006 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-25T09:24:28.007 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2019-11-25T09:24:28.008 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-11-25T09:24:28.194 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-11-25T09:24:28.290 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-11-25T09:24:28.387 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-25T09:24:28.387 INFO:tasks.ceph:{} 2019-11-25T09:24:28.387 INFO:tasks.ceph:osd.5 2019-11-25T09:24:28.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:24:28.388 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-25T09:24:28.921 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-25T09:24:28.921 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-25T09:24:28.921 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=0, sparse=0 2019-11-25T09:24:28.922 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-25T09:24:28.922 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2019-11-25T09:24:28.922 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-25T09:24:28.922 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-25T09:24:28.922 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-25T09:24:28.922 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-25T09:24:28.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2019-11-25T09:24:28.924 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-11-25T09:24:29.049 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-11-25T09:24:29.132 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-11-25T09:24:29.210 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-25T09:24:29.210 INFO:tasks.ceph:{} 2019-11-25T09:24:29.210 INFO:tasks.ceph:osd.6 2019-11-25T09:24:29.210 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:24:29.210 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-25T09:24:29.821 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-25T09:24:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-25T09:24:29.822 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=0, sparse=0 2019-11-25T09:24:29.822 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-25T09:24:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2019-11-25T09:24:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-25T09:24:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-25T09:24:29.823 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-25T09:24:29.823 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-25T09:24:29.824 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2019-11-25T09:24:29.825 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-11-25T09:24:30.008 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-11-25T09:24:30.126 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-11-25T09:24:30.212 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-11-25T09:24:30.212 INFO:tasks.ceph:{} 2019-11-25T09:24:30.212 INFO:tasks.ceph:osd.7 2019-11-25T09:24:30.212 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:24:30.213 INFO:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-25T09:24:30.757 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-25T09:24:30.758 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-25T09:24:30.758 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=0, sparse=0 2019-11-25T09:24:30.758 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-25T09:24:30.758 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2019-11-25T09:24:30.758 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-25T09:24:30.758 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-25T09:24:30.759 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-25T09:24:30.759 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-25T09:24:30.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2019-11-25T09:24:30.760 INFO:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-11-25T09:24:30.908 INFO:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-11-25T09:24:30.994 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:31.094 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.093+0000 7f13506d7b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-11-25T09:24:31.097 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.097+0000 7f13506d7b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-11-25T09:24:31.113 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.113+0000 7f13506d7b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:31.113 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.113+0000 7f13506d7b40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-25T09:24:31.294 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.294+0000 7f13506d7b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:31.295 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.294+0000 7f13506d7b40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:31.295 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.294+0000 7f13506d7b40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:31.316 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-11-25T09:24:31.397 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:31.500 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.499+0000 7f57d986db40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-11-25T09:24:31.502 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.502+0000 7f57d986db40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-11-25T09:24:31.540 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.540+0000 7f57d986db40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:31.541 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.540+0000 7f57d986db40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-25T09:24:31.772 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.772+0000 7f57d986db40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:31.772 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.772+0000 7f57d986db40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:31.773 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:31.772+0000 7f57d986db40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:31.796 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-11-25T09:24:31.905 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:32.039 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.039+0000 7f0dd5d58b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-11-25T09:24:32.040 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.039+0000 7f0dd5d58b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-11-25T09:24:32.055 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.055+0000 7f0dd5d58b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:32.056 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.055+0000 7f0dd5d58b40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-25T09:24:32.202 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.199+0000 7f0dd5d58b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:32.202 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.199+0000 7f0dd5d58b40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:32.202 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.199+0000 7f0dd5d58b40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:32.211 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-11-25T09:24:32.307 INFO:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:32.410 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.410+0000 7fa7b994ab40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-11-25T09:24:32.411 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.410+0000 7fa7b994ab40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-11-25T09:24:32.421 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.421+0000 7fa7b994ab40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:32.421 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.421+0000 7fa7b994ab40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-25T09:24:32.562 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.562+0000 7fa7b994ab40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:32.562 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.562+0000 7fa7b994ab40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:32.562 INFO:teuthology.orchestra.run.smithi174.stderr:2019-11-25T09:24:32.562+0000 7fa7b994ab40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:32.573 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-11-25T09:24:32.653 INFO:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-11-25T09:24:32.769 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-25T09:24:32.769 INFO:tasks.ceph:{} 2019-11-25T09:24:32.769 INFO:tasks.ceph:osd.0 2019-11-25T09:24:32.769 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:24:32.769 INFO:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-11-25T09:24:33.355 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-11-25T09:24:33.355 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-25T09:24:33.356 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=0, sparse=0 2019-11-25T09:24:33.356 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-25T09:24:33.356 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2019-11-25T09:24:33.356 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-25T09:24:33.356 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-25T09:24:33.356 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-25T09:24:33.357 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-25T09:24:33.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2019-11-25T09:24:33.358 INFO:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-11-25T09:24:33.531 INFO:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-11-25T09:24:33.630 INFO:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-11-25T09:24:33.721 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-25T09:24:33.721 INFO:tasks.ceph:{} 2019-11-25T09:24:33.721 INFO:tasks.ceph:osd.1 2019-11-25T09:24:33.721 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:24:33.722 INFO:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-11-25T09:24:34.297 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-11-25T09:24:34.297 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-25T09:24:34.298 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=0, sparse=0 2019-11-25T09:24:34.298 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-25T09:24:34.298 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2019-11-25T09:24:34.298 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-25T09:24:34.298 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-25T09:24:34.298 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-25T09:24:34.298 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-25T09:24:34.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2019-11-25T09:24:34.300 INFO:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-11-25T09:24:34.450 INFO:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-11-25T09:24:34.542 INFO:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-11-25T09:24:34.625 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-25T09:24:34.625 INFO:tasks.ceph:{} 2019-11-25T09:24:34.625 INFO:tasks.ceph:osd.2 2019-11-25T09:24:34.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:24:34.626 INFO:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-11-25T09:24:35.196 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-11-25T09:24:35.196 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-25T09:24:35.196 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=0, sparse=0 2019-11-25T09:24:35.197 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-25T09:24:35.197 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2019-11-25T09:24:35.197 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-25T09:24:35.197 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-25T09:24:35.197 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-25T09:24:35.197 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-25T09:24:35.199 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2019-11-25T09:24:35.199 INFO:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-11-25T09:24:35.357 INFO:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-11-25T09:24:35.446 INFO:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-11-25T09:24:35.551 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-11-25T09:24:35.551 INFO:tasks.ceph:{} 2019-11-25T09:24:35.551 INFO:tasks.ceph:osd.3 2019-11-25T09:24:35.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:24:35.552 INFO:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-11-25T09:24:36.109 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-11-25T09:24:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2019-11-25T09:24:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=0, sparse=0 2019-11-25T09:24:36.110 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-11-25T09:24:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2019-11-25T09:24:36.110 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-11-25T09:24:36.110 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-11-25T09:24:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-11-25T09:24:36.110 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-11-25T09:24:36.112 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2019-11-25T09:24:36.112 INFO:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-11-25T09:24:36.247 INFO:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-11-25T09:24:36.357 INFO:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:36.483 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.467+0000 7f7c31309b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-11-25T09:24:36.483 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.468+0000 7f7c31309b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-11-25T09:24:36.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.479+0000 7f7c31309b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:36.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.479+0000 7f7c31309b40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-25T09:24:36.636 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.620+0000 7f7c31309b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:36.636 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.621+0000 7f7c31309b40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:36.636 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.621+0000 7f7c31309b40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:36.650 INFO:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-11-25T09:24:36.761 INFO:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:36.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.874+0000 7f345fae1b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-11-25T09:24:36.890 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.875+0000 7f345fae1b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-11-25T09:24:36.906 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.890+0000 7f345fae1b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:36.906 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:36.890+0000 7f345fae1b40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-25T09:24:37.037 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.023+0000 7f345fae1b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:37.038 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.023+0000 7f345fae1b40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:37.038 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.023+0000 7f345fae1b40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:37.051 INFO:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-11-25T09:24:37.156 INFO:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:37.314 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.299+0000 7f6fc42aeb40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-11-25T09:24:37.314 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.300+0000 7f6fc42aeb40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-11-25T09:24:37.330 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.315+0000 7f6fc42aeb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:37.330 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.315+0000 7f6fc42aeb40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-25T09:24:37.474 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.459+0000 7f6fc42aeb40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:37.474 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.459+0000 7f6fc42aeb40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:37.474 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.459+0000 7f6fc42aeb40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:37.487 INFO:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-11-25T09:24:37.590 INFO:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:37.718 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.703+0000 7fe9d2b93b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-11-25T09:24:37.718 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.704+0000 7fe9d2b93b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-11-25T09:24:37.730 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.716+0000 7fe9d2b93b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:37.731 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.716+0000 7fe9d2b93b40 -1 journal FileJournal::_open_file : zeroing journal 2019-11-25T09:24:37.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.859+0000 7fe9d2b93b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:24:37.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.859+0000 7fe9d2b93b40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:37.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:24:37.859+0000 7fe9d2b93b40 -1 journal do_read_entry(4096): bad header magic 2019-11-25T09:24:37.885 INFO:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-11-25T09:24:37.981 INFO:tasks.ceph:Reading keys from all nodes... 2019-11-25T09:24:37.981 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-25T09:24:38.075 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.CtdNOiYP7B 2019-11-25T09:24:38.076 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.CtdNOiYP7B 2019-11-25T09:24:38.176 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.CtdNOiYP7B 2019-11-25T09:24:38.372 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.CtdNOiYP7B is 56B 2019-11-25T09:24:38.448 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.CtdNOiYP7B 2019-11-25T09:24:38.511 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-25T09:24:38.662 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.dR1JsvRfLF 2019-11-25T09:24:38.662 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.dR1JsvRfLF 2019-11-25T09:24:38.767 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.dR1JsvRfLF 2019-11-25T09:24:38.923 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.dR1JsvRfLF is 56B 2019-11-25T09:24:38.992 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.dR1JsvRfLF 2019-11-25T09:24:39.060 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-25T09:24:39.195 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.6oDlwACFLC 2019-11-25T09:24:39.196 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.6oDlwACFLC 2019-11-25T09:24:39.283 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.6oDlwACFLC 2019-11-25T09:24:39.430 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.6oDlwACFLC is 56B 2019-11-25T09:24:39.492 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.6oDlwACFLC 2019-11-25T09:24:39.541 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-25T09:24:39.672 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.eg1ZqMTu07 2019-11-25T09:24:39.673 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.eg1ZqMTu07 2019-11-25T09:24:39.753 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.eg1ZqMTu07 2019-11-25T09:24:39.908 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.eg1ZqMTu07 is 56B 2019-11-25T09:24:39.994 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.eg1ZqMTu07 2019-11-25T09:24:40.057 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-25T09:24:40.122 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.3dDW1SVrZ1 2019-11-25T09:24:40.122 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.3dDW1SVrZ1 2019-11-25T09:24:40.204 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.3dDW1SVrZ1 2019-11-25T09:24:40.354 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.3dDW1SVrZ1 is 56B 2019-11-25T09:24:40.418 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.3dDW1SVrZ1 2019-11-25T09:24:40.475 INFO:teuthology.orchestra.run.smithi135:> mktemp 2019-11-25T09:24:40.569 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.zAW9JeWT66 2019-11-25T09:24:40.569 INFO:teuthology.orchestra.run.smithi135:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.zAW9JeWT66 2019-11-25T09:24:40.677 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.zAW9JeWT66 2019-11-25T09:24:40.834 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.zAW9JeWT66 is 56B 2019-11-25T09:24:40.917 INFO:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.zAW9JeWT66 2019-11-25T09:24:40.987 INFO:teuthology.orchestra.run.smithi135:> mktemp 2019-11-25T09:24:41.057 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.YiuWVa73O8 2019-11-25T09:24:41.057 INFO:teuthology.orchestra.run.smithi135:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.YiuWVa73O8 2019-11-25T09:24:41.147 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.YiuWVa73O8 2019-11-25T09:24:41.279 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.YiuWVa73O8 is 56B 2019-11-25T09:24:41.337 INFO:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.YiuWVa73O8 2019-11-25T09:24:41.386 INFO:teuthology.orchestra.run.smithi135:> mktemp 2019-11-25T09:24:41.534 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.wWk9xJJsWa 2019-11-25T09:24:41.535 INFO:teuthology.orchestra.run.smithi135:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.wWk9xJJsWa 2019-11-25T09:24:41.636 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.wWk9xJJsWa 2019-11-25T09:24:41.802 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.wWk9xJJsWa is 56B 2019-11-25T09:24:41.878 INFO:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.wWk9xJJsWa 2019-11-25T09:24:41.950 INFO:teuthology.orchestra.run.smithi135:> mktemp 2019-11-25T09:24:42.015 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.jfpGLjENhp 2019-11-25T09:24:42.015 INFO:teuthology.orchestra.run.smithi135:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.jfpGLjENhp 2019-11-25T09:24:42.097 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.jfpGLjENhp 2019-11-25T09:24:42.239 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.jfpGLjENhp is 56B 2019-11-25T09:24:42.300 INFO:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.jfpGLjENhp 2019-11-25T09:24:42.358 INFO:teuthology.orchestra.run.smithi135:> mktemp 2019-11-25T09:24:42.509 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.ao6WvRY5GV 2019-11-25T09:24:42.510 INFO:teuthology.orchestra.run.smithi135:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.ao6WvRY5GV 2019-11-25T09:24:42.624 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.ao6WvRY5GV 2019-11-25T09:24:42.797 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.ao6WvRY5GV is 56B 2019-11-25T09:24:42.863 INFO:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.ao6WvRY5GV 2019-11-25T09:24:43.018 DEBUG:teuthology.orchestra.remote:smithi174:/etc/ceph/ceph.client.1.keyring is 59B 2019-11-25T09:24:43.187 DEBUG:teuthology.orchestra.remote:smithi135:/etc/ceph/ceph.client.0.keyring is 59B 2019-11-25T09:24:43.280 INFO:tasks.ceph:Adding keys to all mons... 2019-11-25T09:24:43.280 INFO:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-25T09:24:43.285 INFO:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2019-11-25T09:24:43.388 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2019-11-25T09:24:43.388 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDKndtdMhMYLxAAxj1Z71bajDltbOp3oWta1A== 2019-11-25T09:24:43.389 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2019-11-25T09:24:43.389 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDPndtdZPKnBRAAefOeiuzFgKfrLjU569sc1w== 2019-11-25T09:24:43.389 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2019-11-25T09:24:43.389 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDPndtdnfPgHRAAQiKlbP2Dc8EjpbUFKecNcg== 2019-11-25T09:24:43.389 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2019-11-25T09:24:43.389 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDQndtdw+loAhAAY2shN4L5qoUMtBULBX5ebg== 2019-11-25T09:24:43.390 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2019-11-25T09:24:43.390 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDQndtdXpCIGBAAaDniygWAfoo0GafKYpMY9g== 2019-11-25T09:24:43.390 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2019-11-25T09:24:43.390 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDKndtd/2YhOBAAysgz2tqoB9XiwBsJ3Q5Gyw== 2019-11-25T09:24:43.390 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2019-11-25T09:24:43.390 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDUndtdSun8GxAAVAgvilGYV19MPa7/tOrfzw== 2019-11-25T09:24:43.390 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2019-11-25T09:24:43.391 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDUndtdJVE6NBAA/J6GYn4mBJwhYi/jnBabng== 2019-11-25T09:24:43.391 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2019-11-25T09:24:43.391 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDVndtdJdjrERAAwPTnGDf9KMUltZtsg5QJPw== 2019-11-25T09:24:43.391 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2019-11-25T09:24:43.391 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDVndtdUK/9KRAAyjPhjPzb5pxiQtlmBK0A1w== 2019-11-25T09:24:43.391 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2019-11-25T09:24:43.391 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDLndtdaWMBBhAAqVvgBGU1X+yvDfwgITUadA== 2019-11-25T09:24:43.392 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2019-11-25T09:24:43.392 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQDLndtdO+H+DhAA0jiReTKbw1EbX0aEtI0qBQ== 2019-11-25T09:24:43.403 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2019-11-25T09:24:43.404 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDKndtdMhMYLxAAxj1Z71bajDltbOp3oWta1A== 2019-11-25T09:24:43.404 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2019-11-25T09:24:43.404 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDPndtdZPKnBRAAefOeiuzFgKfrLjU569sc1w== 2019-11-25T09:24:43.404 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2019-11-25T09:24:43.404 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDPndtdnfPgHRAAQiKlbP2Dc8EjpbUFKecNcg== 2019-11-25T09:24:43.404 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2019-11-25T09:24:43.405 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDQndtdw+loAhAAY2shN4L5qoUMtBULBX5ebg== 2019-11-25T09:24:43.405 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2019-11-25T09:24:43.405 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDQndtdXpCIGBAAaDniygWAfoo0GafKYpMY9g== 2019-11-25T09:24:43.405 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2019-11-25T09:24:43.405 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDKndtd/2YhOBAAysgz2tqoB9XiwBsJ3Q5Gyw== 2019-11-25T09:24:43.405 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2019-11-25T09:24:43.405 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDUndtdSun8GxAAVAgvilGYV19MPa7/tOrfzw== 2019-11-25T09:24:43.406 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2019-11-25T09:24:43.406 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDUndtdJVE6NBAA/J6GYn4mBJwhYi/jnBabng== 2019-11-25T09:24:43.406 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2019-11-25T09:24:43.406 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDVndtdJdjrERAAwPTnGDf9KMUltZtsg5QJPw== 2019-11-25T09:24:43.406 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2019-11-25T09:24:43.406 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDVndtdUK/9KRAAyjPhjPzb5pxiQtlmBK0A1w== 2019-11-25T09:24:43.406 INFO:teuthology.orchestra.run.smithi174.stdout:[client.1] 2019-11-25T09:24:43.406 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDLndtdaWMBBhAAqVvgBGU1X+yvDfwgITUadA== 2019-11-25T09:24:43.407 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2019-11-25T09:24:43.407 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQDLndtdO+H+DhAA0jiReTKbw1EbX0aEtI0qBQ== 2019-11-25T09:24:43.408 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-25T09:24:43.412 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-25T09:24:43.580 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:43.585 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:43.755 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:43.760 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:43.924 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:43.928 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:44.103 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:44.107 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:44.268 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-25T09:24:44.274 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-11-25T09:24:44.433 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:44.437 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:44.613 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:44.617 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:44.791 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:44.797 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:44.969 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:44.974 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-11-25T09:24:45.134 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-25T09:24:45.141 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-25T09:24:45.308 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-25T09:24:45.313 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-11-25T09:24:45.468 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-11-25T09:24:45.468 INFO:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-11-25T09:24:45.583 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-25T09:24:45.751 INFO:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-11-25T09:24:45.856 INFO:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-11-25T09:24:45.979 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-25T09:24:46.126 INFO:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-11-25T09:24:46.207 INFO:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-11-25T09:24:46.285 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-11-25T09:24:46.401 INFO:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-11-25T09:24:46.467 INFO:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:46.471 INFO:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-11-25T09:24:46.563 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-11-25T09:24:46.564 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-25T09:24:46.564 INFO:tasks.ceph.mon.b:Restarting daemon 2019-11-25T09:24:46.564 INFO:teuthology.orchestra.run.smithi174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2019-11-25T09:24:46.570 INFO:tasks.ceph.mon.b:Started 2019-11-25T09:24:46.570 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-25T09:24:46.570 INFO:tasks.ceph.mon.a:Restarting daemon 2019-11-25T09:24:46.571 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2019-11-25T09:24:46.576 INFO:tasks.ceph.mon.a:Started 2019-11-25T09:24:46.576 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-11-25T09:24:46.576 INFO:tasks.ceph.mon.c:Restarting daemon 2019-11-25T09:24:46.576 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2019-11-25T09:24:46.580 INFO:tasks.ceph.mon.c:Started 2019-11-25T09:24:46.580 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-11-25T09:24:46.581 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-11-25T09:24:46.581 INFO:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2019-11-25T09:24:46.586 INFO:tasks.ceph.mgr.x:Started 2019-11-25T09:24:46.587 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-11-25T09:24:46.588 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2019-11-25T09:24:46.592 INFO:tasks.ceph.mgr.y:Started 2019-11-25T09:24:46.592 INFO:tasks.ceph:Setting crush tunables to default 2019-11-25T09:24:46.592 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd crush tunables default 2019-11-25T09:24:50.433 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:00:03.683 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:24:50.435 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:00:03.686 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:24:50.712 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:00:03.965 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:25:02.628 INFO:teuthology.orchestra.run.smithi135.stderr:adjusted tunables profile to default 2019-11-25T09:25:02.642 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-11-25T09:25:02.643 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-25T09:25:02.711 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.p8RnylKBgx 2019-11-25T09:25:02.712 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.p8RnylKBgx 2019-11-25T09:25:02.789 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.p8RnylKBgx 2019-11-25T09:25:02.907 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.p8RnylKBgx is 37B 2019-11-25T09:25:02.955 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.p8RnylKBgx 2019-11-25T09:25:03.001 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-25T09:25:03.147 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.1MfyhawIiG 2019-11-25T09:25:03.148 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.1MfyhawIiG 2019-11-25T09:25:03.219 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.1MfyhawIiG 2019-11-25T09:25:03.340 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.1MfyhawIiG is 37B 2019-11-25T09:25:03.387 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.1MfyhawIiG 2019-11-25T09:25:03.428 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-25T09:25:03.572 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.zI9UQvHySU 2019-11-25T09:25:03.573 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.zI9UQvHySU 2019-11-25T09:25:03.679 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.zI9UQvHySU 2019-11-25T09:25:03.855 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.zI9UQvHySU is 37B 2019-11-25T09:25:03.913 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.zI9UQvHySU 2019-11-25T09:25:03.962 INFO:teuthology.orchestra.run.smithi174:> mktemp 2019-11-25T09:25:04.085 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.UypoTxL0Zs 2019-11-25T09:25:04.086 INFO:teuthology.orchestra.run.smithi174:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.UypoTxL0Zs 2019-11-25T09:25:04.152 INFO:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.UypoTxL0Zs 2019-11-25T09:25:04.257 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.UypoTxL0Zs is 37B 2019-11-25T09:25:04.307 INFO:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.UypoTxL0Zs 2019-11-25T09:25:04.350 INFO:teuthology.orchestra.run.smithi135:> mktemp 2019-11-25T09:25:04.432 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.EoNkvPMuim 2019-11-25T09:25:04.433 INFO:teuthology.orchestra.run.smithi135:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.EoNkvPMuim 2019-11-25T09:25:04.517 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.EoNkvPMuim 2019-11-25T09:25:04.627 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.EoNkvPMuim is 37B 2019-11-25T09:25:04.677 INFO:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.EoNkvPMuim 2019-11-25T09:25:04.724 INFO:teuthology.orchestra.run.smithi135:> mktemp 2019-11-25T09:25:04.843 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.uIDFWUk1Ji 2019-11-25T09:25:04.844 INFO:teuthology.orchestra.run.smithi135:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.uIDFWUk1Ji 2019-11-25T09:25:04.903 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.uIDFWUk1Ji 2019-11-25T09:25:05.006 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.uIDFWUk1Ji is 37B 2019-11-25T09:25:05.067 INFO:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.uIDFWUk1Ji 2019-11-25T09:25:05.109 INFO:teuthology.orchestra.run.smithi135:> mktemp 2019-11-25T09:25:05.244 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.FXHqcqbWNZ 2019-11-25T09:25:05.244 INFO:teuthology.orchestra.run.smithi135:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.FXHqcqbWNZ 2019-11-25T09:25:05.360 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.FXHqcqbWNZ 2019-11-25T09:25:05.518 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.FXHqcqbWNZ is 37B 2019-11-25T09:25:05.572 INFO:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.FXHqcqbWNZ 2019-11-25T09:25:05.620 INFO:teuthology.orchestra.run.smithi135:> mktemp 2019-11-25T09:25:05.756 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.LHwlrRNP4Y 2019-11-25T09:25:05.757 INFO:teuthology.orchestra.run.smithi135:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.LHwlrRNP4Y 2019-11-25T09:25:05.850 INFO:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.LHwlrRNP4Y 2019-11-25T09:25:05.979 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.LHwlrRNP4Y is 37B 2019-11-25T09:25:06.037 INFO:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.LHwlrRNP4Y 2019-11-25T09:25:06.088 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 666a45f4-74a4-477f-917a-f3e91070474c 0 2019-11-25T09:25:07.338 INFO:teuthology.orchestra.run.smithi135.stdout:0 2019-11-25T09:25:07.357 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 12b907a3-3bf4-426e-bfab-57c2dfacf648 1 2019-11-25T09:25:08.325 INFO:teuthology.orchestra.run.smithi135.stdout:1 2019-11-25T09:25:08.338 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 87304ec0-8a8a-4e57-95ab-16fb216a2be3 2 2019-11-25T09:25:09.383 INFO:teuthology.orchestra.run.smithi135.stdout:2 2019-11-25T09:25:09.406 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new b7c92117-faa0-4af2-ab90-b1f06710846b 3 2019-11-25T09:25:10.525 INFO:teuthology.orchestra.run.smithi135.stdout:3 2019-11-25T09:25:10.545 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 5309b41b-5207-4a1e-8fc9-b5b3dfdf91f3 4 2019-11-25T09:25:11.574 INFO:teuthology.orchestra.run.smithi135.stdout:4 2019-11-25T09:25:11.592 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 677d02fa-a606-44bc-af5e-dcfeec729063 5 2019-11-25T09:25:12.474 INFO:teuthology.orchestra.run.smithi135.stdout:5 2019-11-25T09:25:12.492 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new cdbc9e4a-09b4-4624-a636-4368b28dbc98 6 2019-11-25T09:25:13.685 INFO:teuthology.orchestra.run.smithi135.stdout:6 2019-11-25T09:25:13.715 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new d57f1f84-91d3-491f-9eaf-026e929b65de 7 2019-11-25T09:25:14.750 INFO:teuthology.orchestra.run.smithi135.stdout:7 2019-11-25T09:25:14.766 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-25T09:25:14.767 INFO:tasks.ceph.osd.4:Restarting daemon 2019-11-25T09:25:14.767 INFO:teuthology.orchestra.run.smithi174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2019-11-25T09:25:14.772 INFO:tasks.ceph.osd.4:Started 2019-11-25T09:25:14.772 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-25T09:25:14.773 INFO:tasks.ceph.osd.5:Restarting daemon 2019-11-25T09:25:14.773 INFO:teuthology.orchestra.run.smithi174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2019-11-25T09:25:14.778 INFO:tasks.ceph.osd.5:Started 2019-11-25T09:25:14.778 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-25T09:25:14.779 INFO:tasks.ceph.osd.6:Restarting daemon 2019-11-25T09:25:14.779 INFO:teuthology.orchestra.run.smithi174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2019-11-25T09:25:14.783 INFO:tasks.ceph.osd.6:Started 2019-11-25T09:25:14.783 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-25T09:25:14.783 INFO:tasks.ceph.osd.7:Restarting daemon 2019-11-25T09:25:14.783 INFO:teuthology.orchestra.run.smithi174:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2019-11-25T09:25:14.788 INFO:tasks.ceph.osd.7:Started 2019-11-25T09:25:14.788 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-25T09:25:14.788 INFO:tasks.ceph.osd.0:Restarting daemon 2019-11-25T09:25:14.789 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2019-11-25T09:25:14.793 INFO:tasks.ceph.osd.0:Started 2019-11-25T09:25:14.794 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-25T09:25:14.794 INFO:tasks.ceph.osd.1:Restarting daemon 2019-11-25T09:25:14.794 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2019-11-25T09:25:14.798 INFO:tasks.ceph.osd.1:Started 2019-11-25T09:25:14.799 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-25T09:25:14.799 INFO:tasks.ceph.osd.2:Restarting daemon 2019-11-25T09:25:14.799 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2019-11-25T09:25:14.803 INFO:tasks.ceph.osd.2:Started 2019-11-25T09:25:14.803 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--tool=memcheck'] 2019-11-25T09:25:14.803 INFO:tasks.ceph.osd.3:Restarting daemon 2019-11-25T09:25:14.803 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2019-11-25T09:25:14.807 INFO:tasks.ceph.osd.3:Started 2019-11-25T09:25:14.807 INFO:tasks.ceph:Waiting for OSDs to come up 2019-11-25T09:25:15.616 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-25T09:25:16.685 INFO:teuthology.misc.health.smithi135.stdout: 2019-11-25T09:25:16.685 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":10,"fsid":"577fddeb-3e3f-44bf-adf0-3d64c0d28517","created":"2019-11-25T09:24:59.289305+0000","modified":"2019-11-25T09:25:14.630826+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"666a45f4-74a4-477f-917a-f3e91070474c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12b907a3-3bf4-426e-bfab-57c2dfacf648","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"87304ec0-8a8a-4e57-95ab-16fb216a2be3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7c92117-faa0-4af2-ab90-b1f06710846b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5309b41b-5207-4a1e-8fc9-b5b3dfdf91f3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"677d02fa-a606-44bc-af5e-dcfeec729063","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cdbc9e4a-09b4-4624-a636-4368b28dbc98","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d57f1f84-91d3-491f-9eaf-026e929b65de","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-25T09:25:16.700 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-11-25T09:25:18.641 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T09:25:18.610+0000 9b0d800 -1 Falling back to public interface 2019-11-25T09:25:18.649 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T09:25:18.632+0000 9b0d800 -1 Falling back to public interface 2019-11-25T09:25:18.682 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T09:25:18.673+0000 9b0d800 -1 Falling back to public interface 2019-11-25T09:25:18.688 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T09:25:18.677+0000 9b0d800 -1 Falling back to public interface 2019-11-25T09:25:18.780 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T09:25:18.770+0000 9b0d800 -1 Falling back to public interface 2019-11-25T09:25:19.247 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T09:25:19.214+0000 9b0d800 -1 Falling back to public interface 2019-11-25T09:25:19.445 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T09:25:19.416+0000 9b0d800 -1 Falling back to public interface 2019-11-25T09:25:19.570 INFO:tasks.ceph.osd.2.smithi135.stderr:==00:00:00:04.649 10393== Warning: unimplemented fcntl command: 1036 2019-11-25T09:25:19.573 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T09:25:19.537+0000 9b0d800 -1 Falling back to public interface 2019-11-25T09:25:19.580 INFO:tasks.ceph.osd.4.smithi174.stderr:==00:00:00:04.642 9176== Warning: unimplemented fcntl command: 1036 2019-11-25T09:25:19.646 INFO:tasks.ceph.osd.6.smithi174.stderr:==00:00:00:04.707 9177== Warning: unimplemented fcntl command: 1036 2019-11-25T09:25:19.682 INFO:tasks.ceph.osd.5.smithi174.stderr:==00:00:00:04.753 9175== Warning: unimplemented fcntl command: 1036 2019-11-25T09:25:19.835 INFO:tasks.ceph.osd.7.smithi174.stderr:==00:00:00:04.888 9178== Warning: unimplemented fcntl command: 1036 2019-11-25T09:25:19.948 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T09:25:19.944+0000 9b0d800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:25:19.968 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T09:25:19.918+0000 9b0d800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:25:19.971 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T09:25:19.959+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:19.986 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T09:25:19.962+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.013 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T09:25:19.940+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.017 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T09:25:19.945+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.055 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T09:25:20.050+0000 9b0d800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:25:20.111 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T09:25:20.066+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.138 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T09:25:20.071+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.158 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T09:25:20.130+0000 9b0d800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:25:20.194 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T09:25:20.162+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.194 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T09:25:20.172+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.216 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T09:25:20.201+0000 9b0d800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:25:20.231 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T09:25:20.218+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.233 INFO:tasks.ceph.osd.0.smithi135.stderr:==00:00:00:05.311 10392== Warning: unimplemented fcntl command: 1036 2019-11-25T09:25:20.244 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T09:25:20.221+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.333 INFO:tasks.ceph.osd.1.smithi135.stderr:==00:00:00:05.418 10391== Warning: unimplemented fcntl command: 1036 2019-11-25T09:25:20.541 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T09:25:20.521+0000 9b0d800 -1 osd.2 0 log_to_monitors {default=true} 2019-11-25T09:25:20.553 INFO:tasks.ceph.osd.3.smithi135.stderr:==00:00:00:05.619 10394== Warning: unimplemented fcntl command: 1036 2019-11-25T09:25:20.581 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T09:25:20.574+0000 9b0d800 -1 osd.4 0 log_to_monitors {default=true} 2019-11-25T09:25:20.667 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T09:25:20.634+0000 9b0d800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:25:20.685 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T09:25:20.684+0000 9b0d800 -1 osd.6 0 log_to_monitors {default=true} 2019-11-25T09:25:20.697 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T09:25:20.651+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.705 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T09:25:20.654+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.719 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T09:25:20.687+0000 9b0d800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:25:20.742 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T09:25:20.702+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.748 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T09:25:20.705+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.769 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T09:25:20.768+0000 9b0d800 -1 osd.5 0 log_to_monitors {default=true} 2019-11-25T09:25:20.832 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T09:25:20.830+0000 9b0d800 -1 osd.7 0 log_to_monitors {default=true} 2019-11-25T09:25:20.978 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T09:25:20.943+0000 9b0d800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-11-25T09:25:20.995 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T09:25:20.961+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:20.995 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T09:25:20.964+0000 9b0d800 -1 journal do_read_entry(8192): bad header magic 2019-11-25T09:25:21.292 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T09:25:21.271+0000 9b0d800 -1 osd.0 0 log_to_monitors {default=true} 2019-11-25T09:25:21.377 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T09:25:21.322+0000 9b0d800 -1 osd.1 0 log_to_monitors {default=true} 2019-11-25T09:25:21.620 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T09:25:21.600+0000 9b0d800 -1 osd.3 0 log_to_monitors {default=true} 2019-11-25T09:25:22.197 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T09:25:22.168+0000 29a59700 -1 osd.2 0 waiting for initial osdmap 2019-11-25T09:25:22.394 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T09:25:22.380+0000 29a59700 -1 osd.4 0 waiting for initial osdmap 2019-11-25T09:25:23.341 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T09:25:23.321+0000 29a59700 -1 osd.3 0 waiting for initial osdmap 2019-11-25T09:25:23.362 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T09:25:23.336+0000 29a59700 -1 osd.0 0 waiting for initial osdmap 2019-11-25T09:25:23.373 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T09:25:23.372+0000 29a59700 -1 osd.7 0 waiting for initial osdmap 2019-11-25T09:25:23.418 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T09:25:23.395+0000 29a59700 -1 osd.1 0 waiting for initial osdmap 2019-11-25T09:25:23.421 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T09:25:23.418+0000 29a59700 -1 osd.6 0 waiting for initial osdmap 2019-11-25T09:25:23.507 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-25T09:25:23.564 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T09:25:23.555+0000 29a59700 -1 osd.5 0 waiting for initial osdmap 2019-11-25T09:25:24.369 INFO:teuthology.misc.health.smithi135.stdout: 2019-11-25T09:25:24.369 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":14,"fsid":"577fddeb-3e3f-44bf-adf0-3d64c0d28517","created":"2019-11-25T09:24:59.289305+0000","modified":"2019-11-25T09:25:24.003148+0000","last_up_change":"2019-11-25T09:25:24.003148+0000","last_in_change":"2019-11-25T09:25:24.003148+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"666a45f4-74a4-477f-917a-f3e91070474c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12b907a3-3bf4-426e-bfab-57c2dfacf648","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"87304ec0-8a8a-4e57-95ab-16fb216a2be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":10393},{"type":"v1","addr":"172.21.15.135:6801","nonce":10393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":10393},{"type":"v1","addr":"172.21.15.135:6803","nonce":10393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":10393},{"type":"v1","addr":"172.21.15.135:6807","nonce":10393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":10393},{"type":"v1","addr":"172.21.15.135:6805","nonce":10393}]},"public_addr":"172.21.15.135:6801/10393","cluster_addr":"172.21.15.135:6803/10393","heartbeat_back_addr":"172.21.15.135:6807/10393","heartbeat_front_addr":"172.21.15.135:6805/10393","state":["exists","up"]},{"osd":3,"uuid":"b7c92117-faa0-4af2-ab90-b1f06710846b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5309b41b-5207-4a1e-8fc9-b5b3dfdf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":9176},{"type":"v1","addr":"172.21.15.174:6811","nonce":9176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":9176},{"type":"v1","addr":"172.21.15.174:6815","nonce":9176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":9176},{"type":"v1","addr":"172.21.15.174:6822","nonce":9176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":9176},{"type":"v1","addr":"172.21.15.174:6818","nonce":9176}]},"public_addr":"172.21.15.174:6811/9176","cluster_addr":"172.21.15.174:6815/9176","heartbeat_back_addr":"172.21.15.174:6822/9176","heartbeat_front_addr":"172.21.15.174:6818/9176","state":["exists","up"]},{"osd":5,"uuid":"677d02fa-a606-44bc-af5e-dcfeec729063","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cdbc9e4a-09b4-4624-a636-4368b28dbc98","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d57f1f84-91d3-491f-9eaf-026e929b65de","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.569814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-25T09:25:24.385 DEBUG:teuthology.misc:2 of 8 OSDs are up 2019-11-25T09:25:31.219 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-11-25T09:25:31.953 INFO:teuthology.misc.health.smithi135.stdout: 2019-11-25T09:25:31.953 INFO:teuthology.misc.health.smithi135.stdout:{"epoch":17,"fsid":"577fddeb-3e3f-44bf-adf0-3d64c0d28517","created":"2019-11-25T09:24:59.289305+0000","modified":"2019-11-25T09:25:27.633133+0000","last_up_change":"2019-11-25T09:25:25.098323+0000","last_in_change":"2019-11-25T09:25:25.098323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"666a45f4-74a4-477f-917a-f3e91070474c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":10392},{"type":"v1","addr":"172.21.15.135:6809","nonce":10392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":10392},{"type":"v1","addr":"172.21.15.135:6811","nonce":10392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":10392},{"type":"v1","addr":"172.21.15.135:6815","nonce":10392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":10392},{"type":"v1","addr":"172.21.15.135:6813","nonce":10392}]},"public_addr":"172.21.15.135:6809/10392","cluster_addr":"172.21.15.135:6811/10392","heartbeat_back_addr":"172.21.15.135:6815/10392","heartbeat_front_addr":"172.21.15.135:6813/10392","state":["exists","up"]},{"osd":1,"uuid":"12b907a3-3bf4-426e-bfab-57c2dfacf648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":10391},{"type":"v1","addr":"172.21.15.135:6817","nonce":10391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":10391},{"type":"v1","addr":"172.21.15.135:6819","nonce":10391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":10391},{"type":"v1","addr":"172.21.15.135:6823","nonce":10391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":10391},{"type":"v1","addr":"172.21.15.135:6821","nonce":10391}]},"public_addr":"172.21.15.135:6817/10391","cluster_addr":"172.21.15.135:6819/10391","heartbeat_back_addr":"172.21.15.135:6823/10391","heartbeat_front_addr":"172.21.15.135:6821/10391","state":["exists","up"]},{"osd":2,"uuid":"87304ec0-8a8a-4e57-95ab-16fb216a2be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":10393},{"type":"v1","addr":"172.21.15.135:6801","nonce":10393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":10393},{"type":"v1","addr":"172.21.15.135:6803","nonce":10393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":10393},{"type":"v1","addr":"172.21.15.135:6807","nonce":10393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":10393},{"type":"v1","addr":"172.21.15.135:6805","nonce":10393}]},"public_addr":"172.21.15.135:6801/10393","cluster_addr":"172.21.15.135:6803/10393","heartbeat_back_addr":"172.21.15.135:6807/10393","heartbeat_front_addr":"172.21.15.135:6805/10393","state":["exists","up"]},{"osd":3,"uuid":"b7c92117-faa0-4af2-ab90-b1f06710846b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":10394},{"type":"v1","addr":"172.21.15.135:6825","nonce":10394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":10394},{"type":"v1","addr":"172.21.15.135:6827","nonce":10394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":10394},{"type":"v1","addr":"172.21.15.135:6831","nonce":10394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":10394},{"type":"v1","addr":"172.21.15.135:6829","nonce":10394}]},"public_addr":"172.21.15.135:6825/10394","cluster_addr":"172.21.15.135:6827/10394","heartbeat_back_addr":"172.21.15.135:6831/10394","heartbeat_front_addr":"172.21.15.135:6829/10394","state":["exists","up"]},{"osd":4,"uuid":"5309b41b-5207-4a1e-8fc9-b5b3dfdf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":9176},{"type":"v1","addr":"172.21.15.174:6811","nonce":9176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":9176},{"type":"v1","addr":"172.21.15.174:6815","nonce":9176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":9176},{"type":"v1","addr":"172.21.15.174:6822","nonce":9176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":9176},{"type":"v1","addr":"172.21.15.174:6818","nonce":9176}]},"public_addr":"172.21.15.174:6811/9176","cluster_addr":"172.21.15.174:6815/9176","heartbeat_back_addr":"172.21.15.174:6822/9176","heartbeat_front_addr":"172.21.15.174:6818/9176","state":["exists","up"]},{"osd":5,"uuid":"677d02fa-a606-44bc-af5e-dcfeec729063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":9175},{"type":"v1","addr":"172.21.15.174:6814","nonce":9175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":9175},{"type":"v1","addr":"172.21.15.174:6819","nonce":9175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":9175},{"type":"v1","addr":"172.21.15.174:6825","nonce":9175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":9175},{"type":"v1","addr":"172.21.15.174:6823","nonce":9175}]},"public_addr":"172.21.15.174:6814/9175","cluster_addr":"172.21.15.174:6819/9175","heartbeat_back_addr":"172.21.15.174:6825/9175","heartbeat_front_addr":"172.21.15.174:6823/9175","state":["exists","up"]},{"osd":6,"uuid":"cdbc9e4a-09b4-4624-a636-4368b28dbc98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":9177},{"type":"v1","addr":"172.21.15.174:6803","nonce":9177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":9177},{"type":"v1","addr":"172.21.15.174:6805","nonce":9177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":9177},{"type":"v1","addr":"172.21.15.174:6809","nonce":9177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":9177},{"type":"v1","addr":"172.21.15.174:6807","nonce":9177}]},"public_addr":"172.21.15.174:6803/9177","cluster_addr":"172.21.15.174:6805/9177","heartbeat_back_addr":"172.21.15.174:6809/9177","heartbeat_front_addr":"172.21.15.174:6807/9177","state":["exists","up"]},{"osd":7,"uuid":"d57f1f84-91d3-491f-9eaf-026e929b65de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":9178},{"type":"v1","addr":"172.21.15.174:6827","nonce":9178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":9178},{"type":"v1","addr":"172.21.15.174:6829","nonce":9178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":9178},{"type":"v1","addr":"172.21.15.174:6833","nonce":9178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":9178},{"type":"v1","addr":"172.21.15.174:6831","nonce":9178}]},"public_addr":"172.21.15.174:6827/9178","cluster_addr":"172.21.15.174:6829/9178","heartbeat_back_addr":"172.21.15.174:6833/9178","heartbeat_front_addr":"172.21.15.174:6831/9178","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.409765+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.508621+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.569814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.721934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.746425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.906454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.792063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.007510+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-25T09:25:31.970 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-11-25T09:25:31.970 INFO:tasks.ceph:Creating RBD pool 2019-11-25T09:25:31.970 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd pool create rbd 8 2019-11-25T09:25:33.961 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'rbd' created 2019-11-25T09:25:33.975 INFO:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-11-25T09:25:35.966 INFO:teuthology.orchestra.run.smithi135.stderr:enabled application 'rbd' on pool 'rbd' 2019-11-25T09:25:35.979 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-11-25T09:25:35.979 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-25T09:25:35.980 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-11-25T09:25:36.973 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:25:36.973 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":20,"fsid":"577fddeb-3e3f-44bf-adf0-3d64c0d28517","created":"2019-11-25T09:24:59.289305+0000","modified":"2019-11-25T09:25:35.710491+0000","last_up_change":"2019-11-25T09:25:25.098323+0000","last_in_change":"2019-11-25T09:25:25.098323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-25T09:25:32.724708+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"666a45f4-74a4-477f-917a-f3e91070474c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":10392},{"type":"v1","addr":"172.21.15.135:6809","nonce":10392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":10392},{"type":"v1","addr":"172.21.15.135:6811","nonce":10392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":10392},{"type":"v1","addr":"172.21.15.135:6815","nonce":10392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":10392},{"type":"v1","addr":"172.21.15.135:6813","nonce":10392}]},"public_addr":"172.21.15.135:6809/10392","cluster_addr":"172.21.15.135:6811/10392","heartbeat_back_addr":"172.21.15.135:6815/10392","heartbeat_front_addr":"172.21.15.135:6813/10392","state":["exists","up"]},{"osd":1,"uuid":"12b907a3-3bf4-426e-bfab-57c2dfacf648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":10391},{"type":"v1","addr":"172.21.15.135:6817","nonce":10391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":10391},{"type":"v1","addr":"172.21.15.135:6819","nonce":10391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":10391},{"type":"v1","addr":"172.21.15.135:6823","nonce":10391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":10391},{"type":"v1","addr":"172.21.15.135:6821","nonce":10391}]},"public_addr":"172.21.15.135:6817/10391","cluster_addr":"172.21.15.135:6819/10391","heartbeat_back_addr":"172.21.15.135:6823/10391","heartbeat_front_addr":"172.21.15.135:6821/10391","state":["exists","up"]},{"osd":2,"uuid":"87304ec0-8a8a-4e57-95ab-16fb216a2be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":10393},{"type":"v1","addr":"172.21.15.135:6801","nonce":10393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":10393},{"type":"v1","addr":"172.21.15.135:6803","nonce":10393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":10393},{"type":"v1","addr":"172.21.15.135:6807","nonce":10393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":10393},{"type":"v1","addr":"172.21.15.135:6805","nonce":10393}]},"public_addr":"172.21.15.135:6801/10393","cluster_addr":"172.21.15.135:6803/10393","heartbeat_back_addr":"172.21.15.135:6807/10393","heartbeat_front_addr":"172.21.15.135:6805/10393","state":["exists","up"]},{"osd":3,"uuid":"b7c92117-faa0-4af2-ab90-b1f06710846b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":10394},{"type":"v1","addr":"172.21.15.135:6825","nonce":10394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":10394},{"type":"v1","addr":"172.21.15.135:6827","nonce":10394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":10394},{"type":"v1","addr":"172.21.15.135:6831","nonce":10394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":10394},{"type":"v1","addr":"172.21.15.135:6829","nonce":10394}]},"public_addr":"172.21.15.135:6825/10394","cluster_addr":"172.21.15.135:6827/10394","heartbeat_back_addr":"172.21.15.135:6831/10394","heartbeat_front_addr":"172.21.15.135:6829/10394","state":["exists","up"]},{"osd":4,"uuid":"5309b41b-5207-4a1e-8fc9-b5b3dfdf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":9176},{"type":"v1","addr":"172.21.15.174:6811","nonce":9176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":9176},{"type":"v1","addr":"172.21.15.174:6815","nonce":9176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":9176},{"type":"v1","addr":"172.21.15.174:6822","nonce":9176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":9176},{"type":"v1","addr":"172.21.15.174:6818","nonce":9176}]},"public_addr":"172.21.15.174:6811/9176","cluster_addr":"172.21.15.174:6815/9176","heartbeat_back_addr":"172.21.15.174:6822/9176","heartbeat_front_addr":"172.21.15.174:6818/9176","state":["exists","up"]},{"osd":5,"uuid":"677d02fa-a606-44bc-af5e-dcfeec729063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":9175},{"type":"v1","addr":"172.21.15.174:6814","nonce":9175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":9175},{"type":"v1","addr":"172.21.15.174:6819","nonce":9175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":9175},{"type":"v1","addr":"172.21.15.174:6825","nonce":9175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":9175},{"type":"v1","addr":"172.21.15.174:6823","nonce":9175}]},"public_addr":"172.21.15.174:6814/9175","cluster_addr":"172.21.15.174:6819/9175","heartbeat_back_addr":"172.21.15.174:6825/9175","heartbeat_front_addr":"172.21.15.174:6823/9175","state":["exists","up"]},{"osd":6,"uuid":"cdbc9e4a-09b4-4624-a636-4368b28dbc98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":9177},{"type":"v1","addr":"172.21.15.174:6803","nonce":9177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":9177},{"type":"v1","addr":"172.21.15.174:6805","nonce":9177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":9177},{"type":"v1","addr":"172.21.15.174:6809","nonce":9177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":9177},{"type":"v1","addr":"172.21.15.174:6807","nonce":9177}]},"public_addr":"172.21.15.174:6803/9177","cluster_addr":"172.21.15.174:6805/9177","heartbeat_back_addr":"172.21.15.174:6809/9177","heartbeat_front_addr":"172.21.15.174:6807/9177","state":["exists","up"]},{"osd":7,"uuid":"d57f1f84-91d3-491f-9eaf-026e929b65de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":9178},{"type":"v1","addr":"172.21.15.174:6827","nonce":9178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":9178},{"type":"v1","addr":"172.21.15.174:6829","nonce":9178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":9178},{"type":"v1","addr":"172.21.15.174:6833","nonce":9178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":9178},{"type":"v1","addr":"172.21.15.174:6831","nonce":9178}]},"public_addr":"172.21.15.174:6827/9178","cluster_addr":"172.21.15.174:6829/9178","heartbeat_back_addr":"172.21.15.174:6833/9178","heartbeat_front_addr":"172.21.15.174:6831/9178","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.409765+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.508621+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.569814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.721934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.746425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.906454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.792063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.007510+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-25T09:25:36.993 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-11-25T09:25:32.724708+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'20', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-11-25T09:25:36.993 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-11-25T09:25:37.717 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 8 2019-11-25T09:25:37.734 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-11-25T09:25:37.735 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-11-25T09:25:37.735 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-11-25T09:25:38.858 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:25:38.881 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":8260},{"type":"v1","addr":"172.21.15.174:6801","nonce":8260}]},"active_addr":"172.21.15.174:6801/8260","active_change":"2019-11-25T09:25:03.635297+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"float","level":"advanced","flags":1,"default_value":"0.01","min":"0","max":"1","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the ratio between the fullest and least-full OSD is below this value then we stop trying to optimize placement.","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-11-25T09:25:38.884 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-11-25T09:25:38.885 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-11-25T09:25:38.885 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-25T09:25:39.800 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:25:39.801 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":21,"fsid":"577fddeb-3e3f-44bf-adf0-3d64c0d28517","created":"2019-11-25T09:24:59.289305+0000","modified":"2019-11-25T09:25:36.916131+0000","last_up_change":"2019-11-25T09:25:25.098323+0000","last_in_change":"2019-11-25T09:25:25.098323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-25T09:25:32.724708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"666a45f4-74a4-477f-917a-f3e91070474c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":10392},{"type":"v1","addr":"172.21.15.135:6809","nonce":10392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":10392},{"type":"v1","addr":"172.21.15.135:6811","nonce":10392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":10392},{"type":"v1","addr":"172.21.15.135:6815","nonce":10392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":10392},{"type":"v1","addr":"172.21.15.135:6813","nonce":10392}]},"public_addr":"172.21.15.135:6809/10392","cluster_addr":"172.21.15.135:6811/10392","heartbeat_back_addr":"172.21.15.135:6815/10392","heartbeat_front_addr":"172.21.15.135:6813/10392","state":["exists","up"]},{"osd":1,"uuid":"12b907a3-3bf4-426e-bfab-57c2dfacf648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":10391},{"type":"v1","addr":"172.21.15.135:6817","nonce":10391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":10391},{"type":"v1","addr":"172.21.15.135:6819","nonce":10391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":10391},{"type":"v1","addr":"172.21.15.135:6823","nonce":10391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":10391},{"type":"v1","addr":"172.21.15.135:6821","nonce":10391}]},"public_addr":"172.21.15.135:6817/10391","cluster_addr":"172.21.15.135:6819/10391","heartbeat_back_addr":"172.21.15.135:6823/10391","heartbeat_front_addr":"172.21.15.135:6821/10391","state":["exists","up"]},{"osd":2,"uuid":"87304ec0-8a8a-4e57-95ab-16fb216a2be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":10393},{"type":"v1","addr":"172.21.15.135:6801","nonce":10393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":10393},{"type":"v1","addr":"172.21.15.135:6803","nonce":10393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":10393},{"type":"v1","addr":"172.21.15.135:6807","nonce":10393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":10393},{"type":"v1","addr":"172.21.15.135:6805","nonce":10393}]},"public_addr":"172.21.15.135:6801/10393","cluster_addr":"172.21.15.135:6803/10393","heartbeat_back_addr":"172.21.15.135:6807/10393","heartbeat_front_addr":"172.21.15.135:6805/10393","state":["exists","up"]},{"osd":3,"uuid":"b7c92117-faa0-4af2-ab90-b1f06710846b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":10394},{"type":"v1","addr":"172.21.15.135:6825","nonce":10394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":10394},{"type":"v1","addr":"172.21.15.135:6827","nonce":10394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":10394},{"type":"v1","addr":"172.21.15.135:6831","nonce":10394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":10394},{"type":"v1","addr":"172.21.15.135:6829","nonce":10394}]},"public_addr":"172.21.15.135:6825/10394","cluster_addr":"172.21.15.135:6827/10394","heartbeat_back_addr":"172.21.15.135:6831/10394","heartbeat_front_addr":"172.21.15.135:6829/10394","state":["exists","up"]},{"osd":4,"uuid":"5309b41b-5207-4a1e-8fc9-b5b3dfdf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":9176},{"type":"v1","addr":"172.21.15.174:6811","nonce":9176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":9176},{"type":"v1","addr":"172.21.15.174:6815","nonce":9176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":9176},{"type":"v1","addr":"172.21.15.174:6822","nonce":9176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":9176},{"type":"v1","addr":"172.21.15.174:6818","nonce":9176}]},"public_addr":"172.21.15.174:6811/9176","cluster_addr":"172.21.15.174:6815/9176","heartbeat_back_addr":"172.21.15.174:6822/9176","heartbeat_front_addr":"172.21.15.174:6818/9176","state":["exists","up"]},{"osd":5,"uuid":"677d02fa-a606-44bc-af5e-dcfeec729063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":9175},{"type":"v1","addr":"172.21.15.174:6814","nonce":9175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":9175},{"type":"v1","addr":"172.21.15.174:6819","nonce":9175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":9175},{"type":"v1","addr":"172.21.15.174:6825","nonce":9175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":9175},{"type":"v1","addr":"172.21.15.174:6823","nonce":9175}]},"public_addr":"172.21.15.174:6814/9175","cluster_addr":"172.21.15.174:6819/9175","heartbeat_back_addr":"172.21.15.174:6825/9175","heartbeat_front_addr":"172.21.15.174:6823/9175","state":["exists","up"]},{"osd":6,"uuid":"cdbc9e4a-09b4-4624-a636-4368b28dbc98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":9177},{"type":"v1","addr":"172.21.15.174:6803","nonce":9177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":9177},{"type":"v1","addr":"172.21.15.174:6805","nonce":9177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":9177},{"type":"v1","addr":"172.21.15.174:6809","nonce":9177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":9177},{"type":"v1","addr":"172.21.15.174:6807","nonce":9177}]},"public_addr":"172.21.15.174:6803/9177","cluster_addr":"172.21.15.174:6805/9177","heartbeat_back_addr":"172.21.15.174:6809/9177","heartbeat_front_addr":"172.21.15.174:6807/9177","state":["exists","up"]},{"osd":7,"uuid":"d57f1f84-91d3-491f-9eaf-026e929b65de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":9178},{"type":"v1","addr":"172.21.15.174:6827","nonce":9178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":9178},{"type":"v1","addr":"172.21.15.174:6829","nonce":9178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":9178},{"type":"v1","addr":"172.21.15.174:6833","nonce":9178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":9178},{"type":"v1","addr":"172.21.15.174:6831","nonce":9178}]},"public_addr":"172.21.15.174:6827/9178","cluster_addr":"172.21.15.174:6829/9178","heartbeat_back_addr":"172.21.15.174:6833/9178","heartbeat_front_addr":"172.21.15.174:6831/9178","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.409765+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.508621+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.569814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.721934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.746425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.906454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.792063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.007510+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-25T09:25:39.823 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-11-25T09:25:39.823 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-11-25T09:25:40.721 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:25:40.722 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":21,"fsid":"577fddeb-3e3f-44bf-adf0-3d64c0d28517","created":"2019-11-25T09:24:59.289305+0000","modified":"2019-11-25T09:25:36.916131+0000","last_up_change":"2019-11-25T09:25:25.098323+0000","last_in_change":"2019-11-25T09:25:25.098323+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-11-25T09:25:32.724708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"666a45f4-74a4-477f-917a-f3e91070474c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":10392},{"type":"v1","addr":"172.21.15.135:6809","nonce":10392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":10392},{"type":"v1","addr":"172.21.15.135:6811","nonce":10392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":10392},{"type":"v1","addr":"172.21.15.135:6815","nonce":10392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":10392},{"type":"v1","addr":"172.21.15.135:6813","nonce":10392}]},"public_addr":"172.21.15.135:6809/10392","cluster_addr":"172.21.15.135:6811/10392","heartbeat_back_addr":"172.21.15.135:6815/10392","heartbeat_front_addr":"172.21.15.135:6813/10392","state":["exists","up"]},{"osd":1,"uuid":"12b907a3-3bf4-426e-bfab-57c2dfacf648","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":10391},{"type":"v1","addr":"172.21.15.135:6817","nonce":10391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":10391},{"type":"v1","addr":"172.21.15.135:6819","nonce":10391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":10391},{"type":"v1","addr":"172.21.15.135:6823","nonce":10391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":10391},{"type":"v1","addr":"172.21.15.135:6821","nonce":10391}]},"public_addr":"172.21.15.135:6817/10391","cluster_addr":"172.21.15.135:6819/10391","heartbeat_back_addr":"172.21.15.135:6823/10391","heartbeat_front_addr":"172.21.15.135:6821/10391","state":["exists","up"]},{"osd":2,"uuid":"87304ec0-8a8a-4e57-95ab-16fb216a2be3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":10393},{"type":"v1","addr":"172.21.15.135:6801","nonce":10393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":10393},{"type":"v1","addr":"172.21.15.135:6803","nonce":10393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":10393},{"type":"v1","addr":"172.21.15.135:6807","nonce":10393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":10393},{"type":"v1","addr":"172.21.15.135:6805","nonce":10393}]},"public_addr":"172.21.15.135:6801/10393","cluster_addr":"172.21.15.135:6803/10393","heartbeat_back_addr":"172.21.15.135:6807/10393","heartbeat_front_addr":"172.21.15.135:6805/10393","state":["exists","up"]},{"osd":3,"uuid":"b7c92117-faa0-4af2-ab90-b1f06710846b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":10394},{"type":"v1","addr":"172.21.15.135:6825","nonce":10394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":10394},{"type":"v1","addr":"172.21.15.135:6827","nonce":10394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":10394},{"type":"v1","addr":"172.21.15.135:6831","nonce":10394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":10394},{"type":"v1","addr":"172.21.15.135:6829","nonce":10394}]},"public_addr":"172.21.15.135:6825/10394","cluster_addr":"172.21.15.135:6827/10394","heartbeat_back_addr":"172.21.15.135:6831/10394","heartbeat_front_addr":"172.21.15.135:6829/10394","state":["exists","up"]},{"osd":4,"uuid":"5309b41b-5207-4a1e-8fc9-b5b3dfdf91f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":9176},{"type":"v1","addr":"172.21.15.174:6811","nonce":9176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6813","nonce":9176},{"type":"v1","addr":"172.21.15.174:6815","nonce":9176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":9176},{"type":"v1","addr":"172.21.15.174:6822","nonce":9176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":9176},{"type":"v1","addr":"172.21.15.174:6818","nonce":9176}]},"public_addr":"172.21.15.174:6811/9176","cluster_addr":"172.21.15.174:6815/9176","heartbeat_back_addr":"172.21.15.174:6822/9176","heartbeat_front_addr":"172.21.15.174:6818/9176","state":["exists","up"]},{"osd":5,"uuid":"677d02fa-a606-44bc-af5e-dcfeec729063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":9175},{"type":"v1","addr":"172.21.15.174:6814","nonce":9175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6817","nonce":9175},{"type":"v1","addr":"172.21.15.174:6819","nonce":9175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":9175},{"type":"v1","addr":"172.21.15.174:6825","nonce":9175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6821","nonce":9175},{"type":"v1","addr":"172.21.15.174:6823","nonce":9175}]},"public_addr":"172.21.15.174:6814/9175","cluster_addr":"172.21.15.174:6819/9175","heartbeat_back_addr":"172.21.15.174:6825/9175","heartbeat_front_addr":"172.21.15.174:6823/9175","state":["exists","up"]},{"osd":6,"uuid":"cdbc9e4a-09b4-4624-a636-4368b28dbc98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":9177},{"type":"v1","addr":"172.21.15.174:6803","nonce":9177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":9177},{"type":"v1","addr":"172.21.15.174:6805","nonce":9177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":9177},{"type":"v1","addr":"172.21.15.174:6809","nonce":9177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":9177},{"type":"v1","addr":"172.21.15.174:6807","nonce":9177}]},"public_addr":"172.21.15.174:6803/9177","cluster_addr":"172.21.15.174:6805/9177","heartbeat_back_addr":"172.21.15.174:6809/9177","heartbeat_front_addr":"172.21.15.174:6807/9177","state":["exists","up"]},{"osd":7,"uuid":"d57f1f84-91d3-491f-9eaf-026e929b65de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":9178},{"type":"v1","addr":"172.21.15.174:6827","nonce":9178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":9178},{"type":"v1","addr":"172.21.15.174:6829","nonce":9178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":9178},{"type":"v1","addr":"172.21.15.174:6833","nonce":9178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":9178},{"type":"v1","addr":"172.21.15.174:6831","nonce":9178}]},"public_addr":"172.21.15.174:6827/9178","cluster_addr":"172.21.15.174:6829/9178","heartbeat_back_addr":"172.21.15.174:6833/9178","heartbeat_front_addr":"172.21.15.174:6831/9178","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.409765+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.508621+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.569814+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.721934+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.746425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.906454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:21.792063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-11-25T09:25:22.007510+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-11-25T09:25:40.736 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-11-25T09:25:41.238 INFO:teuthology.orchestra.run.smithi135.stdout:64424509447 2019-11-25T09:25:41.238 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-11-25T09:25:41.778 INFO:teuthology.orchestra.run.smithi135.stdout:64424509448 2019-11-25T09:25:41.779 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-11-25T09:25:42.227 INFO:teuthology.orchestra.run.smithi135.stdout:55834574855 2019-11-25T09:25:42.228 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-11-25T09:25:42.767 INFO:teuthology.orchestra.run.smithi135.stdout:64424509448 2019-11-25T09:25:42.768 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-11-25T09:25:43.321 INFO:teuthology.orchestra.run.smithi135.stdout:60129542151 2019-11-25T09:25:43.322 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-11-25T09:25:43.953 INFO:teuthology.orchestra.run.smithi135.stdout:64424509447 2019-11-25T09:25:43.954 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-11-25T09:25:44.489 INFO:teuthology.orchestra.run.smithi135.stdout:64424509447 2019-11-25T09:25:44.490 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-11-25T09:25:45.137 INFO:teuthology.orchestra.run.smithi135.stdout:64424509447 2019-11-25T09:25:45.137 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-11-25T09:25:45.973 INFO:teuthology.orchestra.run.smithi135.stdout:64424509448 2019-11-25T09:25:45.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.0 2019-11-25T09:25:45.996 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-11-25T09:25:46.807 INFO:teuthology.orchestra.run.smithi135.stdout:64424509448 2019-11-25T09:25:46.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2019-11-25T09:25:46.821 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-11-25T09:25:47.617 INFO:teuthology.orchestra.run.smithi135.stdout:55834574856 2019-11-25T09:25:47.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.2 2019-11-25T09:25:47.638 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-11-25T09:25:48.557 INFO:teuthology.orchestra.run.smithi135.stdout:64424509448 2019-11-25T09:25:48.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2019-11-25T09:25:48.576 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-11-25T09:25:49.418 INFO:teuthology.orchestra.run.smithi135.stdout:60129542152 2019-11-25T09:25:49.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.4 2019-11-25T09:25:49.431 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-11-25T09:25:50.117 INFO:teuthology.orchestra.run.smithi135.stdout:64424509448 2019-11-25T09:25:50.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.5 2019-11-25T09:25:50.130 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-11-25T09:25:50.813 INFO:teuthology.orchestra.run.smithi135.stdout:64424509448 2019-11-25T09:25:50.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.6 2019-11-25T09:25:50.827 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-11-25T09:25:51.475 INFO:teuthology.orchestra.run.smithi135.stdout:64424509448 2019-11-25T09:25:51.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.7 2019-11-25T09:25:51.489 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-11-25T09:25:51.489 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-25T09:25:52.326 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:25:52.327 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2019-11-25T09:25:52.339 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2019-11-25T09:25:51.989388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1699776,"kb_used_data":747895264,"kb_used_omap":311,"kb_used_meta":0,"kb_avail":747895264,"statfs":{"total":767585320960,"available":765844750336,"internally_reserved":0,"allocated":765844750336,"data_stored":765844750336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":319310,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:35.987455+0000","last_change":"2019-11-25T09:25:35.421142+0000","last_active":"2019-11-25T09:25:35.987455+0000","last_peered":"2019-11-25T09:25:35.987455+0000","last_clean":"2019-11-25T09:25:35.987455+0000","last_became_active":"2019-11-25T09:25:35.395019+0000","last_became_peered":"2019-11-25T09:25:35.395019+0000","last_unstale":"2019-11-25T09:25:35.987455+0000","last_undegraded":"2019-11-25T09:25:35.987455+0000","last_fullsized":"2019-11-25T09:25:35.987455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:38.404725+0000","last_change":"2019-11-25T09:25:35.437830+0000","last_active":"2019-11-25T09:25:38.404725+0000","last_peered":"2019-11-25T09:25:38.404725+0000","last_clean":"2019-11-25T09:25:38.404725+0000","last_became_active":"2019-11-25T09:25:35.385831+0000","last_became_peered":"2019-11-25T09:25:35.385831+0000","last_unstale":"2019-11-25T09:25:38.404725+0000","last_undegraded":"2019-11-25T09:25:38.404725+0000","last_fullsized":"2019-11-25T09:25:38.404725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:35.958015+0000","last_change":"2019-11-25T09:25:35.407363+0000","last_active":"2019-11-25T09:25:35.958015+0000","last_peered":"2019-11-25T09:25:35.958015+0000","last_clean":"2019-11-25T09:25:35.958015+0000","last_became_active":"2019-11-25T09:25:35.368153+0000","last_became_peered":"2019-11-25T09:25:35.368153+0000","last_unstale":"2019-11-25T09:25:35.958015+0000","last_undegraded":"2019-11-25T09:25:35.958015+0000","last_fullsized":"2019-11-25T09:25:35.958015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-25T09:25:35.945175+0000","last_change":"2019-11-25T09:25:35.906484+0000","last_active":"2019-11-25T09:25:35.945175+0000","last_peered":"2019-11-25T09:25:35.945175+0000","last_clean":"2019-11-25T09:25:35.945175+0000","last_became_active":"2019-11-25T09:25:35.865545+0000","last_became_peered":"2019-11-25T09:25:35.865545+0000","last_unstale":"2019-11-25T09:25:35.945175+0000","last_undegraded":"2019-11-25T09:25:35.945175+0000","last_fullsized":"2019-11-25T09:25:35.945175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:35.978005+0000","last_change":"2019-11-25T09:25:35.359413+0000","last_active":"2019-11-25T09:25:35.978005+0000","last_peered":"2019-11-25T09:25:35.978005+0000","last_clean":"2019-11-25T09:25:35.978005+0000","last_became_active":"2019-11-25T09:25:35.300222+0000","last_became_peered":"2019-11-25T09:25:35.300222+0000","last_unstale":"2019-11-25T09:25:35.978005+0000","last_undegraded":"2019-11-25T09:25:35.978005+0000","last_fullsized":"2019-11-25T09:25:35.978005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:38.393551+0000","last_change":"2019-11-25T09:25:35.423103+0000","last_active":"2019-11-25T09:25:38.393551+0000","last_peered":"2019-11-25T09:25:38.393551+0000","last_clean":"2019-11-25T09:25:38.393551+0000","last_became_active":"2019-11-25T09:25:35.372849+0000","last_became_peered":"2019-11-25T09:25:35.372849+0000","last_unstale":"2019-11-25T09:25:38.393551+0000","last_undegraded":"2019-11-25T09:25:38.393551+0000","last_fullsized":"2019-11-25T09:25:38.393551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:36.285226+0000","last_change":"2019-11-25T09:25:36.254185+0000","last_active":"2019-11-25T09:25:36.285226+0000","last_peered":"2019-11-25T09:25:36.285226+0000","last_clean":"2019-11-25T09:25:36.285226+0000","last_became_active":"2019-11-25T09:25:36.201599+0000","last_became_peered":"2019-11-25T09:25:36.201599+0000","last_unstale":"2019-11-25T09:25:36.285226+0000","last_undegraded":"2019-11-25T09:25:36.285226+0000","last_fullsized":"2019-11-25T09:25:36.285226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:35.960473+0000","last_change":"2019-11-25T09:25:35.164875+0000","last_active":"2019-11-25T09:25:35.960473+0000","last_peered":"2019-11-25T09:25:35.960473+0000","last_clean":"2019-11-25T09:25:35.960473+0000","last_became_active":"2019-11-25T09:25:35.115539+0000","last_became_peered":"2019-11-25T09:25:35.115539+0000","last_unstale":"2019-11-25T09:25:35.960473+0000","last_undegraded":"2019-11-25T09:25:35.960473+0000","last_fullsized":"2019-11-25T09:25:35.960473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38860,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.660}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.926}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.737}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.300}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.693}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.108}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43636,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":6.211}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":8.240}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.229}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.167}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.553}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.235}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.979}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43226,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":10.946}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.125}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.064}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.607}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.989}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.746}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33964,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.687}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.257}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.668}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.907}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.122}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":45.121}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34040,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.261}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.669}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.958}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.043}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.470}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":50.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":45.896}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43302,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.976}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.071}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.721}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.829}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.198}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.697}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33920,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.762}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.620}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.685}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.944}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.082}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.566}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.139}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":47,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48362,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.859}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":45.975}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.796}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":62.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.160}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":57.203}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":50.485}]}]}]}} 2019-11-25T09:25:52.342 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-11-25T09:25:53.263 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2019-11-25T09:25:53.263 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:25:53.281 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2019-11-25T09:25:51.989388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1699776,"kb_used_data":747895264,"kb_used_omap":311,"kb_used_meta":0,"kb_avail":747895264,"statfs":{"total":767585320960,"available":765844750336,"internally_reserved":0,"allocated":765844750336,"data_stored":765844750336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":319310,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:35.987455+0000","last_change":"2019-11-25T09:25:35.421142+0000","last_active":"2019-11-25T09:25:35.987455+0000","last_peered":"2019-11-25T09:25:35.987455+0000","last_clean":"2019-11-25T09:25:35.987455+0000","last_became_active":"2019-11-25T09:25:35.395019+0000","last_became_peered":"2019-11-25T09:25:35.395019+0000","last_unstale":"2019-11-25T09:25:35.987455+0000","last_undegraded":"2019-11-25T09:25:35.987455+0000","last_fullsized":"2019-11-25T09:25:35.987455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:38.404725+0000","last_change":"2019-11-25T09:25:35.437830+0000","last_active":"2019-11-25T09:25:38.404725+0000","last_peered":"2019-11-25T09:25:38.404725+0000","last_clean":"2019-11-25T09:25:38.404725+0000","last_became_active":"2019-11-25T09:25:35.385831+0000","last_became_peered":"2019-11-25T09:25:35.385831+0000","last_unstale":"2019-11-25T09:25:38.404725+0000","last_undegraded":"2019-11-25T09:25:38.404725+0000","last_fullsized":"2019-11-25T09:25:38.404725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:35.958015+0000","last_change":"2019-11-25T09:25:35.407363+0000","last_active":"2019-11-25T09:25:35.958015+0000","last_peered":"2019-11-25T09:25:35.958015+0000","last_clean":"2019-11-25T09:25:35.958015+0000","last_became_active":"2019-11-25T09:25:35.368153+0000","last_became_peered":"2019-11-25T09:25:35.368153+0000","last_unstale":"2019-11-25T09:25:35.958015+0000","last_undegraded":"2019-11-25T09:25:35.958015+0000","last_fullsized":"2019-11-25T09:25:35.958015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"19","state":"active+clean","last_fresh":"2019-11-25T09:25:35.945175+0000","last_change":"2019-11-25T09:25:35.906484+0000","last_active":"2019-11-25T09:25:35.945175+0000","last_peered":"2019-11-25T09:25:35.945175+0000","last_clean":"2019-11-25T09:25:35.945175+0000","last_became_active":"2019-11-25T09:25:35.865545+0000","last_became_peered":"2019-11-25T09:25:35.865545+0000","last_unstale":"2019-11-25T09:25:35.945175+0000","last_undegraded":"2019-11-25T09:25:35.945175+0000","last_fullsized":"2019-11-25T09:25:35.945175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:35.978005+0000","last_change":"2019-11-25T09:25:35.359413+0000","last_active":"2019-11-25T09:25:35.978005+0000","last_peered":"2019-11-25T09:25:35.978005+0000","last_clean":"2019-11-25T09:25:35.978005+0000","last_became_active":"2019-11-25T09:25:35.300222+0000","last_became_peered":"2019-11-25T09:25:35.300222+0000","last_unstale":"2019-11-25T09:25:35.978005+0000","last_undegraded":"2019-11-25T09:25:35.978005+0000","last_fullsized":"2019-11-25T09:25:35.978005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:38.393551+0000","last_change":"2019-11-25T09:25:35.423103+0000","last_active":"2019-11-25T09:25:38.393551+0000","last_peered":"2019-11-25T09:25:38.393551+0000","last_clean":"2019-11-25T09:25:38.393551+0000","last_became_active":"2019-11-25T09:25:35.372849+0000","last_became_peered":"2019-11-25T09:25:35.372849+0000","last_unstale":"2019-11-25T09:25:38.393551+0000","last_undegraded":"2019-11-25T09:25:38.393551+0000","last_fullsized":"2019-11-25T09:25:38.393551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:36.285226+0000","last_change":"2019-11-25T09:25:36.254185+0000","last_active":"2019-11-25T09:25:36.285226+0000","last_peered":"2019-11-25T09:25:36.285226+0000","last_clean":"2019-11-25T09:25:36.285226+0000","last_became_active":"2019-11-25T09:25:36.201599+0000","last_became_peered":"2019-11-25T09:25:36.201599+0000","last_unstale":"2019-11-25T09:25:36.285226+0000","last_undegraded":"2019-11-25T09:25:36.285226+0000","last_fullsized":"2019-11-25T09:25:36.285226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"20","state":"active+clean","last_fresh":"2019-11-25T09:25:35.960473+0000","last_change":"2019-11-25T09:25:35.164875+0000","last_active":"2019-11-25T09:25:35.960473+0000","last_peered":"2019-11-25T09:25:35.960473+0000","last_clean":"2019-11-25T09:25:35.960473+0000","last_became_active":"2019-11-25T09:25:35.115539+0000","last_became_peered":"2019-11-25T09:25:35.115539+0000","last_unstale":"2019-11-25T09:25:35.960473+0000","last_undegraded":"2019-11-25T09:25:35.960473+0000","last_fullsized":"2019-11-25T09:25:35.960473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-11-25T09:25:33.211242+0000","last_clean_scrub_stamp":"2019-11-25T09:25:33.211242+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":37,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38860,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.660}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.926}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.737}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":37.300}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":28.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.693}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.108}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43636,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":6.211}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":8.240}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.229}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.167}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":14.553}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.235}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.979}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43226,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":10.946}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.125}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.064}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.607}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.989}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.752}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.746}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33964,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.687}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.257}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.668}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.054}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.907}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.122}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":45.121}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34040,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.261}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.669}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.958}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.043}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.470}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":50.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":45.896}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":42,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":43302,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.976}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.071}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.721}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.829}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":26.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.198}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.697}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":33,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33920,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.762}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":24.620}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.685}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.944}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.082}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.566}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.139}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212472,"kb_used_data":93486908,"kb_used_omap":47,"kb_used_meta":0,"kb_avail":93486908,"statfs":{"total":95948165120,"available":95730593792,"internally_reserved":0,"allocated":95730593792,"data_stored":95730593792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":48362,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.859}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":45.975}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.796}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":62.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.160}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":57.203}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":50.485}]}]}]}} 2019-11-25T09:25:53.283 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-11-25T09:25:53.283 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-11-25T09:25:53.283 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-11-25T09:25:53.284 INFO:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-11-25T09:25:54.151 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:25:54.166 INFO:teuthology.orchestra.run.smithi135.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-11-25T09:25:54.166 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-11-25T09:25:54.166 INFO:teuthology.run_tasks:Running task openssl_keys... 2019-11-25T09:25:54.179 INFO:teuthology.run_tasks:Running task rgw... 2019-11-25T09:25:54.197 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2019-11-25T09:25:54.197 DEBUG:tasks.rgw:client list is ['client.0'] 2019-11-25T09:25:54.197 INFO:tasks.rgw:Creating data pools 2019-11-25T09:25:54.197 DEBUG:tasks.rgw:Obtaining remote for client client.0 2019-11-25T09:25:54.198 INFO:teuthology.orchestra.run.smithi135:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2019-11-25T09:25:55.694 INFO:teuthology.orchestra.run.smithi135:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2019-11-25T09:25:58.156 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'default.rgw.buckets.data' created 2019-11-25T09:25:58.171 INFO:teuthology.orchestra.run.smithi135:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2019-11-25T09:25:59.251 INFO:teuthology.orchestra.run.smithi135.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2019-11-25T09:25:59.266 INFO:teuthology.orchestra.run.smithi135:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2019-11-25T09:26:00.365 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'default.rgw.buckets.index' created 2019-11-25T09:26:00.381 INFO:teuthology.orchestra.run.smithi135:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2019-11-25T09:26:01.385 INFO:teuthology.orchestra.run.smithi135.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2019-11-25T09:26:01.398 DEBUG:tasks.rgw:Pools created 2019-11-25T09:26:01.398 INFO:tasks.rgw:Configuring compression type = random 2019-11-25T09:26:01.398 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-25T09:26:01.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-25T09:26:01.398 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-25T09:26:01.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:01.545+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:03.930 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:03.912+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:03.931 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:03.912+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:03.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:03.924+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:03.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:03.924+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:03.953 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:03.935+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:03.953 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:03.935+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:04.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:04.048+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:05.896 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.877+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:05.908 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.890+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:05.908 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.890+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:05.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.897+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:05.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.897+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:05.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.909+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:05.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.909+0000 7ff245a23ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T09:26:05.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.909+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:05.935 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.917+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:05.935 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.917+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:05.948 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.929+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:05.948 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.929+0000 7ff245a23ec0 10 Creating default zonegroup 2019-11-25T09:26:05.948 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.929+0000 7ff245a23ec0 20 get_system_obj_state: rctx=0x7ffe3583e530 obj=:.pools.avail state=0x55c624980e50 s->prefetch_data=0 2019-11-25T09:26:05.951 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:05.933+0000 7ff245a23ec0 10 couldn't find old data placement pools config, setting up new ones for the zone 2019-11-25T09:26:06.151 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:06.132+0000 7ff245a23ec0 10 WARNING: store->list_zones() returned r=-2 2019-11-25T09:26:06.151 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:06.132+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:06.161 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:06.142+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:07.196 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.178+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:07.206 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.187+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:07.207 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.187+0000 7ff245a23ec0 10 could not read realm id: (2) No such file or directory 2019-11-25T09:26:07.207 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.187+0000 7ff245a23ec0 10 WARNING: failed to set zone as default, r=-22 2019-11-25T09:26:07.207 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.187+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:07.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.196+0000 7ff232c51700 0 -- 172.21.15.135:0/1186876750 >> [v2:172.21.15.174:6826/9178,v1:172.21.15.174:6827/9178] conn(0x55c624979e30 msgr2=0x55c62497c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T09:26:07.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.196+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:07.449 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.430+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:07.490 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.471+0000 7ff245a23ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-25T09:26:07.490 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.471+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:07.503 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.485+0000 7ff245a23ec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-25T09:26:07.503 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.485+0000 7ff245a23ec0 20 zonegroup default 2019-11-25T09:26:07.503 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.485+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:07.515 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.496+0000 7ff245a23ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:07.515 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.496+0000 7ff245a23ec0 10 Cannot find current period zone using local zone 2019-11-25T09:26:07.515 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.496+0000 7ff245a23ec0 10 Using default name default 2019-11-25T09:26:07.515 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.496+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:07.550 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.531+0000 7ff245a23ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:07.550 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.531+0000 7ff245a23ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:07.562 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.544+0000 7ff245a23ec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-25T09:26:07.562 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.544+0000 7ff245a23ec0 20 zone default found 2019-11-25T09:26:07.562 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.544+0000 7ff245a23ec0 20 started sync module instance, tier type = 2019-11-25T09:26:07.563 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:07.544+0000 7ff245a23ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T09:26:11.317 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.297+0000 7ff233452700 0 -- 172.21.15.135:0/1186876750 >> [v2:172.21.15.135:6824/10394,v1:172.21.15.135:6825/10394] conn(0x7ff21c0067a0 msgr2=0x7ff21c006bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T09:26:11.970 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.950+0000 7ff245a23ec0 20 add_watcher() i=0 2019-11-25T09:26:11.970 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.950+0000 7ff245a23ec0 20 add_watcher() i=1 2019-11-25T09:26:11.971 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.950+0000 7ff245a23ec0 20 add_watcher() i=2 2019-11-25T09:26:11.971 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.950+0000 7ff245a23ec0 20 add_watcher() i=3 2019-11-25T09:26:11.971 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.950+0000 7ff245a23ec0 20 add_watcher() i=4 2019-11-25T09:26:11.971 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.950+0000 7ff245a23ec0 20 add_watcher() i=5 2019-11-25T09:26:11.971 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.950+0000 7ff245a23ec0 20 add_watcher() i=6 2019-11-25T09:26:12.003 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.983+0000 7ff245a23ec0 20 add_watcher() i=7 2019-11-25T09:26:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.983+0000 7ff245a23ec0 2 all 8 watchers are set, enabling cache 2019-11-25T09:26:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:11.983+0000 7ff2037de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T09:26:16.507 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:16.487+0000 7ff245a23ec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2019-11-25T09:26:21.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:21.194+0000 7ff245a23ec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.log 2019-11-25T09:26:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:25.430+0000 7ff169ffb700 20 reqs_thread_entry: start 2019-11-25T09:26:25.450 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:25.430+0000 7ff15b7fe700 20 reqs_thread_entry: start 2019-11-25T09:26:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:25.431+0000 7ff245a23ec0 20 init_complete bucket index max shards: 0 2019-11-25T09:26:25.451 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:25.432+0000 7ff159ffb700 20 reqs_thread_entry: start 2019-11-25T09:26:25.790 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:25.771+0000 7ff245a23ec0 20 remove_watcher() i=0 2019-11-25T09:26:25.790 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:25.771+0000 7ff245a23ec0 2 removed watcher, disabling cache 2019-11-25T09:26:25.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:25.870+0000 7ff245a23ec0 20 remove_watcher() i=1 2019-11-25T09:26:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:25.952+0000 7ff245a23ec0 20 remove_watcher() i=2 2019-11-25T09:26:26.065 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.046+0000 7ff245a23ec0 20 remove_watcher() i=3 2019-11-25T09:26:26.110 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.091+0000 7ff245a23ec0 20 remove_watcher() i=4 2019-11-25T09:26:26.167 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.147+0000 7ff245a23ec0 20 remove_watcher() i=5 2019-11-25T09:26:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.235+0000 7ff245a23ec0 20 remove_watcher() i=6 2019-11-25T09:26:26.292 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.273+0000 7ff245a23ec0 20 remove_watcher() i=7 2019-11-25T09:26:26.300 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2019-11-25T09:26:26.301 DEBUG:tasks.util.rgw: json result: [] 2019-11-25T09:26:26.301 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-25T09:26:26.301 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-11-25T09:26:26.301 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2019-11-25T09:26:26.481 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.460+0000 7fc484ff9700 20 reqs_thread_entry: start 2019-11-25T09:26:26.482 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.460+0000 7fc50fcfcec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:26.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.483+0000 7fc50fcfcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:26.503 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.483+0000 7fc50fcfcec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:26.523 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.504+0000 7fc50fcfcec0 20 rados_obj.operate() r=0 bl.length=805 2019-11-25T09:26:26.523 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.504+0000 7fc50fcfcec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:26.532 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.513+0000 7fc50fcfcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:26.532 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.513+0000 7fc50fcfcec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:26.548 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.528+0000 7fc50fcfcec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:26.548 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.528+0000 7fc50fcfcec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:26.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.545+0000 7fc50fcfcec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-25T09:26:26.707 INFO:teuthology.orchestra.run.smithi135.stdout:{"id":"b9020152-a9a6-4198-abf1-1fb1ecbb8573","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-25T09:26:26.708 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'b9020152-a9a6-4198-abf1-1fb1ecbb8573', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-25T09:26:26.708 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-11-25T09:26:26.708 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-11-25T09:26:26.708 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-11-25T09:26:26.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.909+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:26.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.953+0000 7f4a59acbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:26.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.953+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:26.983 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.964+0000 7f4a59acbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:26.984 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.964+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:26.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.974+0000 7f4a59acbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:26.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.974+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:26.995+0000 7f4a59acbec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:27.531 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.512+0000 7f4a59acbec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T09:26:27.531 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.512+0000 7f4a59acbec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T09:26:27.532 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.512+0000 7f4a59acbec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T09:26:27.532 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.512+0000 7f4a59acbec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T09:26:27.532 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.512+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.532+0000 7f4a59acbec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:27.556 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.532+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.572 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.553+0000 7f4a59acbec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-25T09:26:27.572 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.553+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.570+0000 7f4a59acbec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:27.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.570+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.611 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.592+0000 7f4a59acbec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-25T09:26:27.611 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.592+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.624 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.604+0000 7f4a59acbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:27.624 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.604+0000 7f4a59acbec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T09:26:27.624 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.604+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.619+0000 7f4a59acbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:27.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.619+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.651 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.632+0000 7f4a59acbec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:27.651 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.632+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.664 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.644+0000 7f4a59acbec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-25T09:26:27.664 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.644+0000 7f4a59acbec0 20 zonegroup default 2019-11-25T09:26:27.664 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.644+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.670 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.651+0000 7f4a59acbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:27.670 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.651+0000 7f4a59acbec0 10 Cannot find current period zone using local zone 2019-11-25T09:26:27.671 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.651+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.658+0000 7f4a59acbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.658+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.687 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.669+0000 7f4a59acbec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:27.688 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.669+0000 7f4a59acbec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:27.697 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.678+0000 7f4a59acbec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-25T09:26:27.697 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.678+0000 7f4a59acbec0 20 zone default found 2019-11-25T09:26:27.698 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.678+0000 7f4a59acbec0 20 started sync module instance, tier type = 2019-11-25T09:26:27.698 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:27.678+0000 7f4a59acbec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T09:26:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.130+0000 7f4a59acbec0 20 add_watcher() i=0 2019-11-25T09:26:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.130+0000 7f4a59acbec0 20 add_watcher() i=1 2019-11-25T09:26:28.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.130+0000 7f4a59acbec0 20 add_watcher() i=2 2019-11-25T09:26:28.151 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.130+0000 7f4a59acbec0 20 add_watcher() i=3 2019-11-25T09:26:28.151 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.130+0000 7f4a59acbec0 20 add_watcher() i=4 2019-11-25T09:26:28.151 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.130+0000 7f4a59acbec0 20 add_watcher() i=5 2019-11-25T09:26:28.151 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.130+0000 7f4a59acbec0 20 add_watcher() i=6 2019-11-25T09:26:28.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.164+0000 7f4a59acbec0 20 add_watcher() i=7 2019-11-25T09:26:28.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.164+0000 7f4a59acbec0 2 all 8 watchers are set, enabling cache 2019-11-25T09:26:28.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.164+0000 7f4a177de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T09:26:28.188 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.169+0000 7f4a474fa700 0 -- 172.21.15.135:0/4004940074 >> v1:172.21.15.135:6789/0 conn(0x5559ce107fa0 legacy=0x5559ce10b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-25T09:26:28.229 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:28.210+0000 7f4a46cf9700 0 -- 172.21.15.135:0/1545660492 >> [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] conn(0x5559ce1205f0 msgr2=0x5559ce122a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-25T09:26:31.007 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:30.988+0000 7f4985ffb700 20 reqs_thread_entry: start 2019-11-25T09:26:31.008 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:30.988+0000 7f497f7fe700 20 reqs_thread_entry: start 2019-11-25T09:26:31.008 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:30.988+0000 7f4a59acbec0 20 init_complete bucket index max shards: 0 2019-11-25T09:26:31.008 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:30.989+0000 7f497dffb700 20 reqs_thread_entry: start 2019-11-25T09:26:31.375 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.355+0000 7f4a59acbec0 20 remove_watcher() i=0 2019-11-25T09:26:31.375 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.355+0000 7f4a59acbec0 2 removed watcher, disabling cache 2019-11-25T09:26:31.405 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.386+0000 7f4a59acbec0 20 remove_watcher() i=1 2019-11-25T09:26:31.443 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.424+0000 7f4a59acbec0 20 remove_watcher() i=2 2019-11-25T09:26:31.480 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.461+0000 7f4a59acbec0 20 remove_watcher() i=3 2019-11-25T09:26:31.508 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.490+0000 7f4a59acbec0 20 remove_watcher() i=4 2019-11-25T09:26:31.557 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.538+0000 7f4a59acbec0 20 remove_watcher() i=5 2019-11-25T09:26:31.598 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.578+0000 7f4a59acbec0 20 remove_watcher() i=6 2019-11-25T09:26:31.626 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.607+0000 7f4a59acbec0 20 remove_watcher() i=7 2019-11-25T09:26:31.632 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2019-11-25T09:26:31.633 DEBUG:tasks.util.rgw: json result: [] 2019-11-25T09:26:31.633 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2019-11-25T09:26:31.633 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-25T09:26:31.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-11-25T09:26:31.634 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2019-11-25T09:26:31.790 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.770+0000 7ff2337fe700 20 reqs_thread_entry: start 2019-11-25T09:26:31.790 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.770+0000 7ff2fe24eec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:31.802 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.783+0000 7ff2fe24eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:31.802 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.783+0000 7ff2fe24eec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:31.815 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.796+0000 7ff2fe24eec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:31.815 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.796+0000 7ff2fe24eec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:31.824 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.804+0000 7ff2fe24eec0 20 rados_obj.operate() r=0 bl.length=348 2019-11-25T09:26:31.824 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.804+0000 7ff2fe24eec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:31.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:31.813+0000 7ff2fe24eec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-25T09:26:31.868 INFO:teuthology.orchestra.run.smithi135.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2019-11-25T09:26:31.868 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-25T09:26:31.869 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-25T09:26:31.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-11-25T09:26:31.869 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2019-11-25T09:26:32.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.065+0000 7fd9bb7fe700 20 reqs_thread_entry: start 2019-11-25T09:26:32.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.066+0000 7fda86000ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.105 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.086+0000 7fda86000ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:32.107 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.086+0000 7fda86000ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.120 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.101+0000 7fda86000ec0 20 rados_obj.operate() r=0 bl.length=821 2019-11-25T09:26:32.120 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.101+0000 7fda86000ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.110+0000 7fda86000ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:32.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.110+0000 7fda86000ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.138 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.119+0000 7fda86000ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:32.138 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.119+0000 7fda86000ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.151 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.132+0000 7fda86000ec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-25T09:26:32.209 INFO:teuthology.orchestra.run.smithi135.stdout:{"id":"b9020152-a9a6-4198-abf1-1fb1ecbb8573","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-25T09:26:32.209 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'b9020152-a9a6-4198-abf1-1fb1ecbb8573', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-25T09:26:32.210 INFO:tasks.rgw:Configuring storage class type = FROZEN 2019-11-25T09:26:32.210 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-25T09:26:32.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-11-25T09:26:32.210 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2019-11-25T09:26:32.371 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.351+0000 7f78577fe700 20 reqs_thread_entry: start 2019-11-25T09:26:32.372 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.351+0000 7f79229ddec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.390 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.370+0000 7f79229ddec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:32.390 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.370+0000 7f79229ddec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.420 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.393+0000 7f79229ddec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:32.420 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.393+0000 7f79229ddec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.433 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.410+0000 7f79229ddec0 20 rados_obj.operate() r=0 bl.length=372 2019-11-25T09:26:32.433 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.410+0000 7f79229ddec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.446 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.426+0000 7f79229ddec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-25T09:26:32.513 INFO:teuthology.orchestra.run.smithi135.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2019-11-25T09:26:32.514 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-11-25T09:26:32.514 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-25T09:26:32.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-11-25T09:26:32.514 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2019-11-25T09:26:32.790 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.770+0000 7f2a80ff9700 20 reqs_thread_entry: start 2019-11-25T09:26:32.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.770+0000 7f2b43635ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.785+0000 7f2b43635ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:32.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.785+0000 7f2b43635ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.826 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.806+0000 7f2b43635ec0 20 rados_obj.operate() r=0 bl.length=888 2019-11-25T09:26:32.827 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.806+0000 7f2b43635ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.814+0000 7f2b43635ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:26:32.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.814+0000 7f2b43635ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.843 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.823+0000 7f2b43635ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:26:32.843 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.823+0000 7f2b43635ec0 20 rados->read ofs=0 len=0 2019-11-25T09:26:32.859 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:26:32.839+0000 7f2b43635ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:26:32.933 INFO:teuthology.orchestra.run.smithi135.stdout:{"id":"b9020152-a9a6-4198-abf1-1fb1ecbb8573","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-11-25T09:26:32.933 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'b9020152-a9a6-4198-abf1-1fb1ecbb8573', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-11-25T09:26:32.933 INFO:tasks.rgw:Starting rgw... 2019-11-25T09:26:32.934 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2019-11-25T09:26:32.934 INFO:tasks.rgw:Using civetweb as radosgw frontend 2019-11-25T09:26:32.934 DEBUG:teuthology.misc:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--tool=memcheck', '--max-threads=1024'] 2019-11-25T09:26:32.934 INFO:tasks.rgw.client.0:Restarting daemon 2019-11-25T09:26:32.934 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'civetweb port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2019-11-25T09:26:32.939 INFO:tasks.rgw.client.0:Started 2019-11-25T09:26:32.939 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi135.front.sepia.ceph.com:80/ 2019-11-25T09:26:32.939 INFO:teuthology.orchestra.run.smithi135:> curl http://smithi135.front.sepia.ceph.com:80/ 2019-11-25T09:26:33.027 INFO:teuthology.orchestra.run.smithi135.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-25T09:26:33.027 INFO:teuthology.orchestra.run.smithi135.stderr: Dload Upload Total Spent Left Speed 2019-11-25T09:26:33.031 INFO:teuthology.orchestra.run.smithi135.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi135.front.sepia.ceph.com:80; Connection refused 2019-11-25T09:26:33.031 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-25T09:26:34.033 INFO:teuthology.orchestra.run.smithi135:> curl http://smithi135.front.sepia.ceph.com:80/ 2019-11-25T09:26:34.109 INFO:teuthology.orchestra.run.smithi135.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-25T09:26:34.109 INFO:teuthology.orchestra.run.smithi135.stderr: Dload Upload Total Spent Left Speed 2019-11-25T09:26:34.112 INFO:teuthology.orchestra.run.smithi135.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi135.front.sepia.ceph.com:80; Connection refused 2019-11-25T09:26:34.112 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-25T09:26:36.114 INFO:teuthology.orchestra.run.smithi135:> curl http://smithi135.front.sepia.ceph.com:80/ 2019-11-25T09:26:36.199 INFO:teuthology.orchestra.run.smithi135.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-25T09:26:36.201 INFO:teuthology.orchestra.run.smithi135.stderr: Dload Upload Total Spent Left Speed 2019-11-25T09:26:36.204 INFO:teuthology.orchestra.run.smithi135.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi135.front.sepia.ceph.com:80; Connection refused 2019-11-25T09:26:36.204 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-25T09:26:40.205 INFO:teuthology.orchestra.run.smithi135:> curl http://smithi135.front.sepia.ceph.com:80/ 2019-11-25T09:26:40.284 INFO:teuthology.orchestra.run.smithi135.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-25T09:26:40.285 INFO:teuthology.orchestra.run.smithi135.stderr: Dload Upload Total Spent Left Speed 2019-11-25T09:26:40.289 INFO:teuthology.orchestra.run.smithi135.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi135.front.sepia.ceph.com:80; Connection refused 2019-11-25T09:26:40.289 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-11-25T09:26:48.291 INFO:teuthology.orchestra.run.smithi135:> curl http://smithi135.front.sepia.ceph.com:80/ 2019-11-25T09:26:48.337 INFO:teuthology.orchestra.run.smithi135.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-11-25T09:26:48.337 INFO:teuthology.orchestra.run.smithi135.stderr: Dload Upload Total Spent Left Speed 2019-11-25T09:26:48.983 INFO:teuthology.orchestra.run.smithi135.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 331 0 --:--:-- --:--:-- --:--:-- 331 2019-11-25T09:26:48.984 INFO:teuthology.orchestra.run.smithi135.stdout:anonymous 2019-11-25T09:26:48.984 INFO:teuthology.run_tasks:Running task workunit... 2019-11-25T09:26:49.000 INFO:tasks.workunit:Pulling workunits from ref 12b9659be24ae0e3d791f80d81504ab2770c1343 2019-11-25T09:26:49.001 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-11-25T09:26:49.001 INFO:teuthology.orchestra.run.smithi135:> stat -- /home/ubuntu/cephtest/mnt.0 2019-11-25T09:26:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:stat: cannot stat ‘/home/ubuntu/cephtest/mnt.0’: No such file or directory 2019-11-25T09:26:49.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-25T09:26:49.058 INFO:teuthology.orchestra.run.smithi135:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-11-25T09:26:49.104 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2019-11-25T09:26:49.105 INFO:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2019-11-25T09:26:49.148 INFO:tasks.workunit:timeout=3h 2019-11-25T09:26:49.149 INFO:tasks.workunit:cleanup=True 2019-11-25T09:26:49.150 INFO:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 12b9659be24ae0e3d791f80d81504ab2770c1343 2019-11-25T09:26:49.514 INFO:tasks.workunit.client.0.smithi135.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2019-11-25T09:27:51.192 INFO:tasks.workunit.client.0.smithi135.stderr:Note: checking out '12b9659be24ae0e3d791f80d81504ab2770c1343'. 2019-11-25T09:27:51.192 INFO:tasks.workunit.client.0.smithi135.stderr: 2019-11-25T09:27:51.192 INFO:tasks.workunit.client.0.smithi135.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-11-25T09:27:51.192 INFO:tasks.workunit.client.0.smithi135.stderr:changes and commit them, and you can discard any commits you make in this 2019-11-25T09:27:51.192 INFO:tasks.workunit.client.0.smithi135.stderr:state without impacting any branches by performing another checkout. 2019-11-25T09:27:51.193 INFO:tasks.workunit.client.0.smithi135.stderr: 2019-11-25T09:27:51.193 INFO:tasks.workunit.client.0.smithi135.stderr:If you want to create a new branch to retain commits you create, you may 2019-11-25T09:27:51.193 INFO:tasks.workunit.client.0.smithi135.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-11-25T09:27:51.193 INFO:tasks.workunit.client.0.smithi135.stderr: 2019-11-25T09:27:51.193 INFO:tasks.workunit.client.0.smithi135.stderr: git checkout -b new_branch_name 2019-11-25T09:27:51.193 INFO:tasks.workunit.client.0.smithi135.stderr: 2019-11-25T09:27:51.193 INFO:tasks.workunit.client.0.smithi135.stderr:HEAD is now at 12b9659... rgw/pubsub: add ssl+sasl security to kafka 2019-11-25T09:27:51.194 INFO:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2019-11-25T09:27:51.291 INFO:tasks.workunit.client.0.smithi135.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-11-25T09:27:51.296 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-25T09:27:51.296 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-11-25T09:27:51.811 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-11-25T09:27:51.900 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-11-25T09:27:51.935 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-11-25T09:27:51.936 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-25T09:27:51.936 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-11-25T09:27:51.971 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-11-25T09:27:52.018 DEBUG:teuthology.orchestra.remote:smithi135:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2019-11-25T09:27:52.065 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2019-11-25T09:27:52.065 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2019-11-25T09:27:52.066 INFO:teuthology.orchestra.run.smithi135:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=12b9659be24ae0e3d791f80d81504ab2770c1343 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2019-11-25T09:27:52.121 INFO:tasks.workunit.client.0.smithi135.stdout:Running main() from gmock_main.cc 2019-11-25T09:27:52.121 INFO:tasks.workunit.client.0.smithi135.stdout:[==========] Running 11 tests from 1 test suite. 2019-11-25T09:27:52.121 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] Global test environment set-up. 2019-11-25T09:27:52.121 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] 11 tests from ClsLock 2019-11-25T09:27:52.122 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestMultiLocking 2019-11-25T09:27:54.681 INFO:tasks.workunit.client.0.smithi135.stdout:lock: mylock 2019-11-25T09:27:54.681 INFO:tasks.workunit.client.0.smithi135.stdout: lock_type: exclusive 2019-11-25T09:27:54.681 INFO:tasks.workunit.client.0.smithi135.stdout: tag: 2019-11-25T09:27:54.681 INFO:tasks.workunit.client.0.smithi135.stdout: lockers: 2019-11-25T09:27:54.682 INFO:tasks.workunit.client.0.smithi135.stdout: client.4367 expiration=2019-11-25T09:29:54.549937+0000 addr=v1:172.21.15.135:0/2729127521 cookie= 2019-11-25T09:27:54.811 INFO:tasks.workunit.client.0.smithi135.stdout:lock: mylock 2019-11-25T09:27:54.811 INFO:tasks.workunit.client.0.smithi135.stdout: lock_type: shared 2019-11-25T09:27:54.811 INFO:tasks.workunit.client.0.smithi135.stdout: tag: 2019-11-25T09:27:54.811 INFO:tasks.workunit.client.0.smithi135.stdout: lockers: 2019-11-25T09:27:54.812 INFO:tasks.workunit.client.0.smithi135.stdout: client.4367 expiration=2019-11-25T09:29:54.765545+0000 addr=v1:172.21.15.135:0/2729127521 cookie= 2019-11-25T09:27:54.812 INFO:tasks.workunit.client.0.smithi135.stdout: client.4373 expiration=0.000000 addr=v1:172.21.15.135:0/3796780905 cookie= 2019-11-25T09:27:54.862 INFO:tasks.workunit.client.0.smithi135.stdout:lock: mylock 2019-11-25T09:27:54.862 INFO:tasks.workunit.client.0.smithi135.stdout: lock_type: shared 2019-11-25T09:27:54.862 INFO:tasks.workunit.client.0.smithi135.stdout: tag: 2019-11-25T09:27:54.862 INFO:tasks.workunit.client.0.smithi135.stdout: lockers: 2019-11-25T09:27:54.862 INFO:tasks.workunit.client.0.smithi135.stdout: client.4373 expiration=0.000000 addr=v1:172.21.15.135:0/3796780905 cookie= 2019-11-25T09:27:55.211 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestMultiLocking (3090 ms) 2019-11-25T09:27:55.211 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestMeta 2019-11-25T09:27:58.011 INFO:tasks.workunit.client.0.smithi135.stdout:lock: mylock 2019-11-25T09:27:58.011 INFO:tasks.workunit.client.0.smithi135.stdout: lock_type: shared 2019-11-25T09:27:58.011 INFO:tasks.workunit.client.0.smithi135.stdout: tag: 2019-11-25T09:27:58.011 INFO:tasks.workunit.client.0.smithi135.stdout: lockers: 2019-11-25T09:27:58.011 INFO:tasks.workunit.client.0.smithi135.stdout: client.4510 expiration=0.000000 addr=v1:172.21.15.135:0/3981886357 cookie= 2019-11-25T09:27:58.099 INFO:tasks.workunit.client.0.smithi135.stdout:lock: mylock 2019-11-25T09:27:58.100 INFO:tasks.workunit.client.0.smithi135.stdout: lock_type: exclusive 2019-11-25T09:27:58.100 INFO:tasks.workunit.client.0.smithi135.stdout: tag: new_tag 2019-11-25T09:27:58.100 INFO:tasks.workunit.client.0.smithi135.stdout: lockers: 2019-11-25T09:27:58.100 INFO:tasks.workunit.client.0.smithi135.stdout: client.4501 expiration=0.000000 addr=v1:172.21.15.135:0/2860044023 cookie= 2019-11-25T09:27:58.671 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestMeta (3460 ms) 2019-11-25T09:27:58.671 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestCookie 2019-11-25T09:28:01.646 INFO:tasks.workunit.client.0.smithi135.stdout:lock: mylock 2019-11-25T09:28:01.646 INFO:tasks.workunit.client.0.smithi135.stdout: lock_type: exclusive 2019-11-25T09:28:01.646 INFO:tasks.workunit.client.0.smithi135.stdout: tag: 2019-11-25T09:28:01.646 INFO:tasks.workunit.client.0.smithi135.stdout: lockers: 2019-11-25T09:28:01.738 INFO:tasks.workunit.client.0.smithi135.stdout:lock: mylock 2019-11-25T09:28:01.738 INFO:tasks.workunit.client.0.smithi135.stdout: lock_type: shared 2019-11-25T09:28:01.738 INFO:tasks.workunit.client.0.smithi135.stdout: tag: 2019-11-25T09:28:01.738 INFO:tasks.workunit.client.0.smithi135.stdout: lockers: 2019-11-25T09:28:01.738 INFO:tasks.workunit.client.0.smithi135.stdout: client.4379 expiration=0.000000 addr=v1:172.21.15.135:0/1267127077 cookie= 2019-11-25T09:28:01.739 INFO:tasks.workunit.client.0.smithi135.stdout: client.4379 expiration=0.000000 addr=v1:172.21.15.135:0/1267127077 cookie=new cookie 2019-11-25T09:28:02.129 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestCookie (3458 ms) 2019-11-25T09:28:02.129 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestMultipleLocks 2019-11-25T09:28:05.694 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestMultipleLocks (3565 ms) 2019-11-25T09:28:05.694 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestLockDuration 2019-11-25T09:28:13.995 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestLockDuration (8301 ms) 2019-11-25T09:28:13.996 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestAssertLocked 2019-11-25T09:28:17.487 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestAssertLocked (3491 ms) 2019-11-25T09:28:17.487 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestSetCookie 2019-11-25T09:28:20.923 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestSetCookie (3435 ms) 2019-11-25T09:28:20.923 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestRenew 2019-11-25T09:28:43.456 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestRenew (22533 ms) 2019-11-25T09:28:43.456 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2019-11-25T09:28:51.382 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7926 ms) 2019-11-25T09:28:51.383 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2019-11-25T09:28:59.615 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8232 ms) 2019-11-25T09:28:59.615 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2019-11-25T09:29:08.726 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (9111 ms) 2019-11-25T09:29:08.726 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] 11 tests from ClsLock (76602 ms total) 2019-11-25T09:29:08.726 INFO:tasks.workunit.client.0.smithi135.stdout: 2019-11-25T09:29:08.726 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] Global test environment tear-down 2019-11-25T09:29:08.726 INFO:tasks.workunit.client.0.smithi135.stdout:[==========] 11 tests from 1 test suite ran. (76602 ms total) 2019-11-25T09:29:08.727 INFO:tasks.workunit.client.0.smithi135.stdout:[ PASSED ] 11 tests. 2019-11-25T09:29:08.728 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-25T09:29:08.729 INFO:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-25T09:29:08.912 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2019-11-25T09:29:08.912 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2019-11-25T09:29:08.912 INFO:teuthology.orchestra.run.smithi135:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=12b9659be24ae0e3d791f80d81504ab2770c1343 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2019-11-25T09:29:08.996 INFO:tasks.workunit.client.0.smithi135.stdout:Running main() from gmock_main.cc 2019-11-25T09:29:08.997 INFO:tasks.workunit.client.0.smithi135.stdout:[==========] Running 4 tests from 1 test suite. 2019-11-25T09:29:08.997 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] Global test environment set-up. 2019-11-25T09:29:08.997 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] 4 tests from cls_log 2019-11-25T09:29:08.997 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_log.test_log_add_same_time 2019-11-25T09:29:11.966 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_log.test_log_add_same_time (2968 ms) 2019-11-25T09:29:11.966 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_log.test_log_add_different_time 2019-11-25T09:29:15.672 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_log.test_log_add_different_time (3707 ms) 2019-11-25T09:29:15.672 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_log.trim_by_time 2019-11-25T09:29:21.253 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_log.trim_by_time (5581 ms) 2019-11-25T09:29:21.253 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_log.trim_by_marker 2019-11-25T09:29:26.020 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_log.trim_by_marker (4768 ms) 2019-11-25T09:29:26.021 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] 4 tests from cls_log (17024 ms total) 2019-11-25T09:29:26.021 INFO:tasks.workunit.client.0.smithi135.stdout: 2019-11-25T09:29:26.021 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] Global test environment tear-down 2019-11-25T09:29:26.021 INFO:tasks.workunit.client.0.smithi135.stdout:[==========] 4 tests from 1 test suite ran. (17024 ms total) 2019-11-25T09:29:26.021 INFO:tasks.workunit.client.0.smithi135.stdout:[ PASSED ] 4 tests. 2019-11-25T09:29:26.022 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-25T09:29:26.023 INFO:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-25T09:29:26.091 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2019-11-25T09:29:26.091 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2019-11-25T09:29:26.092 INFO:teuthology.orchestra.run.smithi135:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=12b9659be24ae0e3d791f80d81504ab2770c1343 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2019-11-25T09:29:26.152 INFO:tasks.workunit.client.0.smithi135.stdout:Running main() from gmock_main.cc 2019-11-25T09:29:26.152 INFO:tasks.workunit.client.0.smithi135.stdout:[==========] Running 5 tests from 1 test suite. 2019-11-25T09:29:26.152 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] Global test environment set-up. 2019-11-25T09:29:26.152 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] 5 tests from cls_rgw 2019-11-25T09:29:26.152 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.test_implicit 2019-11-25T09:29:29.610 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.test_implicit (3454 ms) 2019-11-25T09:29:29.610 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2019-11-25T09:29:33.012 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3406 ms) 2019-11-25T09:29:33.012 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.test_put_snap 2019-11-25T09:29:41.955 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T09:29:41.891+0000 36a73700 -1 osd.5 pg_epoch: 106 pg[25.6( v 105'4 (0'0,105'4] local-lis/les=102/103 n=2 ec=102/102 lis/c=102/102 les/c/f=103/103/0 sis=102) [5,1] r=0 lpr=102 crt=104'3 lcod 104'3 mlcod 104'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2019-11-25T09:29:43.360 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.test_put_snap (10347 ms) 2019-11-25T09:29:43.360 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.test_explicit 2019-11-25T09:29:46.726 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.test_explicit (3366 ms) 2019-11-25T09:29:46.726 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.set 2019-11-25T09:29:50.199 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.set (3473 ms) 2019-11-25T09:29:50.199 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] 5 tests from cls_rgw (24046 ms total) 2019-11-25T09:29:50.199 INFO:tasks.workunit.client.0.smithi135.stdout: 2019-11-25T09:29:50.199 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] Global test environment tear-down 2019-11-25T09:29:50.200 INFO:tasks.workunit.client.0.smithi135.stdout:[==========] 5 tests from 1 test suite ran. (24046 ms total) 2019-11-25T09:29:50.200 INFO:tasks.workunit.client.0.smithi135.stdout:[ PASSED ] 5 tests. 2019-11-25T09:29:50.201 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-25T09:29:50.201 INFO:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-25T09:29:50.270 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2019-11-25T09:29:50.270 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2019-11-25T09:29:50.270 INFO:teuthology.orchestra.run.smithi135:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=12b9659be24ae0e3d791f80d81504ab2770c1343 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2019-11-25T09:29:50.323 INFO:tasks.workunit.client.0.smithi135.stdout:Running main() from gmock_main.cc 2019-11-25T09:29:50.323 INFO:tasks.workunit.client.0.smithi135.stdout:[==========] Running 13 tests from 1 test suite. 2019-11-25T09:29:50.324 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] Global test environment set-up. 2019-11-25T09:29:50.324 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] 13 tests from cls_rgw 2019-11-25T09:29:52.632 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.index_basic 2019-11-25T09:29:54.602 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.index_basic (1971 ms) 2019-11-25T09:29:54.602 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2019-11-25T09:29:56.444 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (1842 ms) 2019-11-25T09:29:56.444 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.index_remove_object 2019-11-25T09:29:59.387 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.index_remove_object (2943 ms) 2019-11-25T09:29:59.388 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.index_suggest 2019-11-25T09:30:40.109 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.index_suggest (40719 ms) 2019-11-25T09:30:40.110 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.index_list 2019-11-25T09:30:41.368 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.index_list (1260 ms) 2019-11-25T09:30:41.369 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.bi_list 2019-11-25T09:30:45.450 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.bi_list (4081 ms) 2019-11-25T09:30:45.451 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.gc_set 2019-11-25T09:30:46.189 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.gc_set (739 ms) 2019-11-25T09:30:46.189 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.gc_list 2019-11-25T09:30:46.765 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.gc_list (576 ms) 2019-11-25T09:30:46.765 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.gc_defer 2019-11-25T09:30:55.447 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.gc_defer (8682 ms) 2019-11-25T09:30:55.448 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.usage_basic 2019-11-25T09:31:05.150 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.usage_basic (9701 ms) 2019-11-25T09:31:05.150 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2019-11-25T09:31:05.187 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.usage_clear_no_obj (38 ms) 2019-11-25T09:31:05.187 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.usage_clear 2019-11-25T09:31:12.168 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.usage_clear (6980 ms) 2019-11-25T09:31:12.168 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] cls_rgw.bi_log_trim 2019-11-25T09:31:15.132 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] cls_rgw.bi_log_trim (2964 ms) 2019-11-25T09:31:15.412 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] 13 tests from cls_rgw (82496 ms total) 2019-11-25T09:31:15.412 INFO:tasks.workunit.client.0.smithi135.stdout: 2019-11-25T09:31:15.413 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] Global test environment tear-down 2019-11-25T09:31:15.413 INFO:tasks.workunit.client.0.smithi135.stdout:[==========] 13 tests from 1 test suite ran. (85084 ms total) 2019-11-25T09:31:15.413 INFO:tasks.workunit.client.0.smithi135.stdout:[ PASSED ] 13 tests. 2019-11-25T09:31:15.414 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-25T09:31:15.414 INFO:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-25T09:31:15.534 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2019-11-25T09:31:15.534 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2019-11-25T09:31:15.534 INFO:teuthology.orchestra.run.smithi135:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=12b9659be24ae0e3d791f80d81504ab2770c1343 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2019-11-25T09:31:15.606 INFO:tasks.workunit.client.0.smithi135.stdout:[==========] Running 6 tests from 1 test suite. 2019-11-25T09:31:15.606 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] Global test environment set-up. 2019-11-25T09:31:17.750 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] 6 tests from rgw_gc_log 2019-11-25T09:31:17.750 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2019-11-25T09:31:18.261 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] rgw_gc_log.init_existing_queue (511 ms) 2019-11-25T09:31:18.261 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2019-11-25T09:31:18.459 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] rgw_gc_log.init_existing_omap (198 ms) 2019-11-25T09:31:18.459 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2019-11-25T09:31:18.561 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (102 ms) 2019-11-25T09:31:18.561 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2019-11-25T09:31:18.626 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (65 ms) 2019-11-25T09:31:18.626 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2019-11-25T09:31:18.727 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] rgw_gc_log.defer1_after_init (101 ms) 2019-11-25T09:31:18.727 INFO:tasks.workunit.client.0.smithi135.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2019-11-25T09:31:18.771 INFO:tasks.workunit.client.0.smithi135.stdout:[ OK ] rgw_gc_log.defer2_before_init (44 ms) 2019-11-25T09:31:18.772 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] 6 tests from rgw_gc_log (1021 ms total) 2019-11-25T09:31:18.772 INFO:tasks.workunit.client.0.smithi135.stdout: 2019-11-25T09:31:18.772 INFO:tasks.workunit.client.0.smithi135.stdout:[----------] Global test environment tear-down 2019-11-25T09:31:18.970 INFO:tasks.workunit.client.0.smithi135.stdout:[==========] 6 tests from 1 test suite ran. (3360 ms total) 2019-11-25T09:31:18.971 INFO:tasks.workunit.client.0.smithi135.stdout:[ PASSED ] 6 tests. 2019-11-25T09:31:18.971 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-11-25T09:31:18.971 INFO:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-11-25T09:31:19.093 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh'] on client.0... 2019-11-25T09:31:19.093 INFO:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2019-11-25T09:31:19.321 DEBUG:teuthology.parallel:result is None 2019-11-25T09:31:19.322 INFO:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2019-11-25T09:31:19.378 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2019-11-25T09:31:19.379 INFO:teuthology.orchestra.run.smithi135:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-11-25T09:31:19.431 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2019-11-25T09:31:19.431 INFO:teuthology.run_tasks:Running task ragweed... 2019-11-25T09:31:19.444 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2019-11-25T09:31:19.444 INFO:tasks.ragweed:Downloading ragweed... 2019-11-25T09:31:19.444 INFO:tasks.ragweed:Using branch 'wip-yuval-add-kafka-security2' for ragweed 2019-11-25T09:31:19.444 INFO:teuthology.orchestra.run.smithi135:> git clone -b wip-yuval-add-kafka-security2 git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-25T09:31:19.506 INFO:teuthology.orchestra.run.smithi135.stderr:fatal: Remote branch wip-yuval-add-kafka-security2 not found in upstream origin 2019-11-25T09:31:19.507 INFO:teuthology.orchestra.run.smithi135.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-25T09:31:19.515 DEBUG:teuthology.orchestra.run:got remote process result: 128 2019-11-25T09:31:19.515 INFO:teuthology.orchestra.run.smithi135:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-11-25T09:31:19.615 INFO:teuthology.orchestra.run.smithi135.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-11-25T09:31:19.696 INFO:tasks.ragweed:Creating rgw users... 2019-11-25T09:31:19.697 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2019-11-25T09:31:19.697 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key AAGJSFGJUKFDMDMQNIYF --secret UCqnw8VeLokiAtQ2vPxJLq6ry3rwB9vlR2accNZiTI8CgmPGjwIGjg== --email sysuser.client.0+test@test.test --system true 2019-11-25T09:31:19.834 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:19.801+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:19.910 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:19.876+0000 7f728abd6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:19.911 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:19.876+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:19.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:19.882+0000 7f728abd6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:19.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:19.882+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:19.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:19.888+0000 7f728abd6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:19.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:19.888+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:19.957 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:19.924+0000 7f728abd6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:31:20.217 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.184+0000 7f728abd6ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T09:31:20.218 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.184+0000 7f728abd6ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T09:31:20.218 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.184+0000 7f728abd6ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T09:31:20.218 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.184+0000 7f728abd6ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T09:31:20.218 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.184+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.226 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.194+0000 7f728abd6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:31:20.227 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.194+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.245 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.212+0000 7f728abd6ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:31:20.245 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.212+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.255 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.222+0000 7f728abd6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:31:20.255 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.222+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.271 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.238+0000 7f728abd6ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:31:20.271 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.238+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.279 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.246+0000 7f728abd6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:20.279 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.246+0000 7f728abd6ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T09:31:20.279 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.246+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.288 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.250+0000 7f728abd6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:20.289 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.251+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.261+0000 7f728abd6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:31:20.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.261+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.304 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.271+0000 7f728abd6ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:31:20.304 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.271+0000 7f728abd6ec0 20 zonegroup default 2019-11-25T09:31:20.304 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.271+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.309 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.276+0000 7f728abd6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:20.309 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.276+0000 7f728abd6ec0 10 Cannot find current period zone using local zone 2019-11-25T09:31:20.310 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.276+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.316 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.283+0000 7f728abd6ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:20.316 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.283+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.294+0000 7f728abd6ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:31:20.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.294+0000 7f728abd6ec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:20.336 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.303+0000 7f728abd6ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:31:20.336 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.303+0000 7f728abd6ec0 20 zone default found 2019-11-25T09:31:20.336 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.303+0000 7f728abd6ec0 20 started sync module instance, tier type = 2019-11-25T09:31:20.337 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.303+0000 7f728abd6ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T09:31:20.677 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.644+0000 7f728abd6ec0 20 add_watcher() i=0 2019-11-25T09:31:20.677 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.644+0000 7f728abd6ec0 20 add_watcher() i=1 2019-11-25T09:31:20.677 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.644+0000 7f728abd6ec0 20 add_watcher() i=2 2019-11-25T09:31:20.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.644+0000 7f728abd6ec0 20 add_watcher() i=3 2019-11-25T09:31:20.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.644+0000 7f728abd6ec0 20 add_watcher() i=4 2019-11-25T09:31:20.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.644+0000 7f728abd6ec0 20 add_watcher() i=5 2019-11-25T09:31:20.679 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.646+0000 7f728abd6ec0 20 add_watcher() i=6 2019-11-25T09:31:20.717 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.684+0000 7f728abd6ec0 20 add_watcher() i=7 2019-11-25T09:31:20.717 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.684+0000 7f728abd6ec0 2 all 8 watchers are set, enabling cache 2019-11-25T09:31:20.717 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.684+0000 7f71cbfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T09:31:20.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.692+0000 7f726ffff700 0 -- 172.21.15.135:0/3916002496 >> v1:172.21.15.174:6789/0 conn(0x556113355e80 legacy=0x556113358390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T09:31:20.752 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:20.719+0000 7f7278605700 0 -- 172.21.15.135:0/800054664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556113354ac0 msgr2=0x556113354ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T09:31:22.293 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.260+0000 7f71b67fc700 20 reqs_thread_entry: start 2019-11-25T09:31:22.293 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.260+0000 7f71affff700 20 reqs_thread_entry: start 2019-11-25T09:31:22.293 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.260+0000 7f728abd6ec0 20 init_complete bucket index max shards: 0 2019-11-25T09:31:22.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.261+0000 7f71ae7fc700 20 reqs_thread_entry: start 2019-11-25T09:31:22.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.261+0000 7f728abd6ec0 20 get_system_obj_state: rctx=0x7fff9525c0b8 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x5561133d07c0 s->prefetch_data=0 2019-11-25T09:31:22.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.261+0000 7f728abd6ec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-25T09:31:22.310 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.277+0000 7f728abd6ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2019-11-25T09:31:22.310 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.277+0000 7f728abd6ec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-25T09:31:22.310 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.277+0000 7f728abd6ec0 20 get_system_obj_state: rctx=0x7fff9525c0c8 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x5561133d2550 s->prefetch_data=0 2019-11-25T09:31:22.310 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.277+0000 7f728abd6ec0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2019-11-25T09:31:22.322 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.289+0000 7f728abd6ec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2019-11-25T09:31:22.322 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.289+0000 7f728abd6ec0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-25T09:31:22.322 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.289+0000 7f728abd6ec0 20 get_system_obj_state: rctx=0x7fff9525c0c8 obj=default.rgw.meta:users.keys:AAGJSFGJUKFDMDMQNIYF state=0x5561133d2550 s->prefetch_data=0 2019-11-25T09:31:22.322 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.289+0000 7f728abd6ec0 10 cache get: name=default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF : miss 2019-11-25T09:31:22.334 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.301+0000 7f728abd6ec0 10 cache put: name=default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF info.flags=0x0 2019-11-25T09:31:22.334 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.301+0000 7f728abd6ec0 10 adding default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF to cache LRU end 2019-11-25T09:31:22.334 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.301+0000 7f728abd6ec0 20 get_system_obj_state: rctx=0x7fff9525bcd8 obj=default.rgw.meta:users.keys:AAGJSFGJUKFDMDMQNIYF state=0x5561133d2550 s->prefetch_data=0 2019-11-25T09:31:22.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.301+0000 7f728abd6ec0 10 cache get: name=default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF : type miss (requested=0x6, cached=0x0) 2019-11-25T09:31:22.341 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.308+0000 7f728abd6ec0 10 cache put: name=default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF info.flags=0x0 2019-11-25T09:31:22.341 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.308+0000 7f728abd6ec0 10 moving default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF to cache LRU end 2019-11-25T09:31:22.341 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.308+0000 7f728abd6ec0 20 get_system_obj_state: rctx=0x7fff9525be58 obj=default.rgw.meta:users.keys:AAGJSFGJUKFDMDMQNIYF state=0x5561133d2550 s->prefetch_data=0 2019-11-25T09:31:22.342 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.308+0000 7f728abd6ec0 10 cache get: name=default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF : type miss (requested=0x6, cached=0x0) 2019-11-25T09:31:22.348 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.315+0000 7f728abd6ec0 10 cache put: name=default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF info.flags=0x0 2019-11-25T09:31:22.348 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.315+0000 7f728abd6ec0 10 moving default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF to cache LRU end 2019-11-25T09:31:22.423 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.390+0000 7f728abd6ec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-25T09:31:22.424 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.390+0000 7f728abd6ec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-25T09:31:22.424 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.390+0000 7f728abd6ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2019-11-25T09:31:22.488 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.454+0000 7f726d7fa700 10 RGWWatcher::handle_notify() notify_id 536870912000 cookie 93875422363696 notifier 4618 bl.length()=637 2019-11-25T09:31:22.488 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.454+0000 7f726d7fa700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-11-25T09:31:22.488 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.454+0000 7f726d7fa700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-25T09:31:22.933 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.900+0000 7f728abd6ec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-25T09:31:22.934 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.900+0000 7f728abd6ec0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-25T09:31:22.934 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.900+0000 7f728abd6ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2019-11-25T09:31:22.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.939+0000 7f726d7fa700 10 RGWWatcher::handle_notify() notify_id 536870912001 cookie 93875422367536 notifier 4618 bl.length()=202 2019-11-25T09:31:22.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.939+0000 7f726d7fa700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-11-25T09:31:22.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:22.939+0000 7f726d7fa700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-11-25T09:31:23.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.075+0000 7f728abd6ec0 10 cache put: name=default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF info.flags=0x7 2019-11-25T09:31:23.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.075+0000 7f728abd6ec0 10 moving default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF to cache LRU end 2019-11-25T09:31:23.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.075+0000 7f728abd6ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=190 2019-11-25T09:31:23.138 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.104+0000 7f726d7fa700 10 RGWWatcher::handle_notify() notify_id 536870912000 cookie 93875422362016 notifier 4618 bl.length()=190 2019-11-25T09:31:23.139 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.104+0000 7f726d7fa700 10 cache put: name=default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF info.flags=0x7 2019-11-25T09:31:23.139 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.104+0000 7f726d7fa700 10 moving default.rgw.meta+users.keys+AAGJSFGJUKFDMDMQNIYF to cache LRU end 2019-11-25T09:31:23.252 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2019-11-25T09:31:23.252 INFO:teuthology.orchestra.run.smithi135.stdout: "user_id": "sysuser.client.0", 2019-11-25T09:31:23.252 INFO:teuthology.orchestra.run.smithi135.stdout: "display_name": "Mr. sysuser.client.0", 2019-11-25T09:31:23.253 INFO:teuthology.orchestra.run.smithi135.stdout: "email": "sysuser.client.0+test@test.test", 2019-11-25T09:31:23.253 INFO:teuthology.orchestra.run.smithi135.stdout: "suspended": 0, 2019-11-25T09:31:23.253 INFO:teuthology.orchestra.run.smithi135.stdout: "max_buckets": 1000, 2019-11-25T09:31:23.253 INFO:teuthology.orchestra.run.smithi135.stdout: "subusers": [], 2019-11-25T09:31:23.253 INFO:teuthology.orchestra.run.smithi135.stdout: "keys": [ 2019-11-25T09:31:23.253 INFO:teuthology.orchestra.run.smithi135.stdout: { 2019-11-25T09:31:23.253 INFO:teuthology.orchestra.run.smithi135.stdout: "user": "sysuser.client.0", 2019-11-25T09:31:23.254 INFO:teuthology.orchestra.run.smithi135.stdout: "access_key": "AAGJSFGJUKFDMDMQNIYF", 2019-11-25T09:31:23.254 INFO:teuthology.orchestra.run.smithi135.stdout: "secret_key": "UCqnw8VeLokiAtQ2vPxJLq6ry3rwB9vlR2accNZiTI8CgmPGjwIGjg==" 2019-11-25T09:31:23.254 INFO:teuthology.orchestra.run.smithi135.stdout: } 2019-11-25T09:31:23.254 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2019-11-25T09:31:23.254 INFO:teuthology.orchestra.run.smithi135.stdout: "swift_keys": [], 2019-11-25T09:31:23.254 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": [], 2019-11-25T09:31:23.254 INFO:teuthology.orchestra.run.smithi135.stdout: "op_mask": "read, write, delete", 2019-11-25T09:31:23.255 INFO:teuthology.orchestra.run.smithi135.stdout: "system": "true", 2019-11-25T09:31:23.255 INFO:teuthology.orchestra.run.smithi135.stdout: "default_placement": "", 2019-11-25T09:31:23.255 INFO:teuthology.orchestra.run.smithi135.stdout: "default_storage_class": "", 2019-11-25T09:31:23.255 INFO:teuthology.orchestra.run.smithi135.stdout: "placement_tags": [], 2019-11-25T09:31:23.255 INFO:teuthology.orchestra.run.smithi135.stdout: "bucket_quota": { 2019-11-25T09:31:23.255 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T09:31:23.255 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T09:31:23.256 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T09:31:23.256 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T09:31:23.256 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T09:31:23.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T09:31:23.256 INFO:teuthology.orchestra.run.smithi135.stdout: "user_quota": { 2019-11-25T09:31:23.256 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T09:31:23.256 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T09:31:23.257 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T09:31:23.257 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T09:31:23.257 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T09:31:23.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T09:31:23.257 INFO:teuthology.orchestra.run.smithi135.stdout: "temp_url_keys": [], 2019-11-25T09:31:23.257 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "rgw", 2019-11-25T09:31:23.257 INFO:teuthology.orchestra.run.smithi135.stdout: "mfa_ids": [] 2019-11-25T09:31:23.257 INFO:teuthology.orchestra.run.smithi135.stdout:} 2019-11-25T09:31:23.258 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:23.291 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.258+0000 7f728abd6ec0 20 remove_watcher() i=0 2019-11-25T09:31:23.292 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.258+0000 7f728abd6ec0 2 removed watcher, disabling cache 2019-11-25T09:31:23.331 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.297+0000 7f728abd6ec0 20 remove_watcher() i=1 2019-11-25T09:31:23.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.336+0000 7f728abd6ec0 20 remove_watcher() i=2 2019-11-25T09:31:23.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.366+0000 7f728abd6ec0 20 remove_watcher() i=3 2019-11-25T09:31:23.436 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.402+0000 7f728abd6ec0 20 remove_watcher() i=4 2019-11-25T09:31:23.474 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.440+0000 7f728abd6ec0 20 remove_watcher() i=5 2019-11-25T09:31:23.517 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.483+0000 7f728abd6ec0 20 remove_watcher() i=6 2019-11-25T09:31:23.561 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.527+0000 7f728abd6ec0 20 remove_watcher() i=7 2019-11-25T09:31:23.568 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2019-11-25T09:31:23.568 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key FDHTKSXNTKHRSAZDQMFO --secret nqYVs6ib4o/xqaTtC2sWKzK1/iqT/J9yLUKNum8IetUOQaw8Ojc3WQ== --email ragweed.client.0+test@test.test --system false 2019-11-25T09:31:23.705 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.671+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:23.735 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.701+0000 7f4eb525fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:23.735 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.701+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:23.742 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.708+0000 7f4eb525fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:23.743 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.708+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:23.749 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.715+0000 7f4eb525fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:23.749 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.715+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:23.772 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.738+0000 7f4eb525fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:31:23.986 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.951+0000 7f4eb525fec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T09:31:23.986 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.951+0000 7f4eb525fec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T09:31:23.986 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.951+0000 7f4eb525fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T09:31:23.986 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.951+0000 7f4eb525fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T09:31:23.986 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.952+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.000 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.965+0000 7f4eb525fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:31:24.000 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.965+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.008 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.974+0000 7f4eb525fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:31:24.008 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.974+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.020 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.987+0000 7f4eb525fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:31:24.021 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.987+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.033 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.999+0000 7f4eb525fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:31:24.033 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:23.999+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.005+0000 7f4eb525fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:24.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.005+0000 7f4eb525fec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T09:31:24.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.005+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.011+0000 7f4eb525fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:24.046 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.011+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.021+0000 7f4eb525fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:31:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.021+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.032+0000 7f4eb525fec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:31:24.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.032+0000 7f4eb525fec0 20 zonegroup default 2019-11-25T09:31:24.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.032+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.073 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.039+0000 7f4eb525fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:24.074 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.039+0000 7f4eb525fec0 10 Cannot find current period zone using local zone 2019-11-25T09:31:24.074 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.039+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.046+0000 7f4eb525fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:31:24.080 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.046+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.058+0000 7f4eb525fec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:31:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.058+0000 7f4eb525fec0 20 rados->read ofs=0 len=0 2019-11-25T09:31:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.066+0000 7f4eb525fec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:31:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.066+0000 7f4eb525fec0 20 zone default found 2019-11-25T09:31:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.066+0000 7f4eb525fec0 20 started sync module instance, tier type = 2019-11-25T09:31:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.066+0000 7f4eb525fec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T09:31:24.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.460+0000 7f4eb525fec0 20 add_watcher() i=0 2019-11-25T09:31:24.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.460+0000 7f4eb525fec0 20 add_watcher() i=1 2019-11-25T09:31:24.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.460+0000 7f4eb525fec0 20 add_watcher() i=2 2019-11-25T09:31:24.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.460+0000 7f4eb525fec0 20 add_watcher() i=3 2019-11-25T09:31:24.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.460+0000 7f4eb525fec0 20 add_watcher() i=4 2019-11-25T09:31:24.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.460+0000 7f4eb525fec0 20 add_watcher() i=5 2019-11-25T09:31:24.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.460+0000 7f4eb525fec0 20 add_watcher() i=6 2019-11-25T09:31:24.528 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.493+0000 7f4eb525fec0 20 add_watcher() i=7 2019-11-25T09:31:24.528 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.493+0000 7f4eb525fec0 2 all 8 watchers are set, enabling cache 2019-11-25T09:31:24.528 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.494+0000 7f4e72fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T09:31:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.496+0000 7f4ea2c8e700 0 -- 172.21.15.135:0/2334939194 >> v1:172.21.15.135:6789/0 conn(0x560745533e10 legacy=0x560745537400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T09:31:24.567 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:24.533+0000 7f4ea1c8c700 0 -- 172.21.15.135:0/3696603689 >> [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] conn(0x56074554c4b0 msgr2=0x56074554e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T09:31:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.345+0000 7f4de17fa700 20 reqs_thread_entry: start 2019-11-25T09:31:26.381 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.345+0000 7f4ddaffd700 20 reqs_thread_entry: start 2019-11-25T09:31:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.345+0000 7f4eb525fec0 20 init_complete bucket index max shards: 0 2019-11-25T09:31:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.346+0000 7f4dd97fa700 20 reqs_thread_entry: start 2019-11-25T09:31:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.346+0000 7f4eb525fec0 20 get_system_obj_state: rctx=0x7ffc31ceea28 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x5607455b5c80 s->prefetch_data=0 2019-11-25T09:31:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.346+0000 7f4eb525fec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-25T09:31:26.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.356+0000 7f4eb525fec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2019-11-25T09:31:26.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.356+0000 7f4eb525fec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-25T09:31:26.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.356+0000 7f4eb525fec0 20 get_system_obj_state: rctx=0x7ffc31ceea38 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x5607455b7a10 s->prefetch_data=0 2019-11-25T09:31:26.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.356+0000 7f4eb525fec0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2019-11-25T09:31:26.397 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.364+0000 7f4eb525fec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2019-11-25T09:31:26.397 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.364+0000 7f4eb525fec0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-25T09:31:26.397 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.364+0000 7f4eb525fec0 20 get_system_obj_state: rctx=0x7ffc31ceea38 obj=default.rgw.meta:users.keys:FDHTKSXNTKHRSAZDQMFO state=0x5607455b7a10 s->prefetch_data=0 2019-11-25T09:31:26.397 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.364+0000 7f4eb525fec0 10 cache get: name=default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO : miss 2019-11-25T09:31:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.370+0000 7f4eb525fec0 10 cache put: name=default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO info.flags=0x0 2019-11-25T09:31:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.370+0000 7f4eb525fec0 10 adding default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO to cache LRU end 2019-11-25T09:31:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.370+0000 7f4eb525fec0 20 get_system_obj_state: rctx=0x7ffc31cee648 obj=default.rgw.meta:users.keys:FDHTKSXNTKHRSAZDQMFO state=0x5607455b7a10 s->prefetch_data=0 2019-11-25T09:31:26.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.370+0000 7f4eb525fec0 10 cache get: name=default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO : type miss (requested=0x6, cached=0x0) 2019-11-25T09:31:26.410 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.377+0000 7f4eb525fec0 10 cache put: name=default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO info.flags=0x0 2019-11-25T09:31:26.410 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.377+0000 7f4eb525fec0 10 moving default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO to cache LRU end 2019-11-25T09:31:26.411 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.377+0000 7f4eb525fec0 20 get_system_obj_state: rctx=0x7ffc31cee7c8 obj=default.rgw.meta:users.keys:FDHTKSXNTKHRSAZDQMFO state=0x5607455b7a10 s->prefetch_data=0 2019-11-25T09:31:26.411 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.377+0000 7f4eb525fec0 10 cache get: name=default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO : type miss (requested=0x6, cached=0x0) 2019-11-25T09:31:26.415 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.382+0000 7f4eb525fec0 10 cache put: name=default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO info.flags=0x0 2019-11-25T09:31:26.415 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.382+0000 7f4eb525fec0 10 moving default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO to cache LRU end 2019-11-25T09:31:26.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.442+0000 7f4eb525fec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-25T09:31:26.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.442+0000 7f4eb525fec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-25T09:31:26.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.442+0000 7f4eb525fec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2019-11-25T09:31:26.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.462+0000 7f4e837fe700 10 RGWWatcher::handle_notify() notify_id 536870912002 cookie 94589227786736 notifier 4636 bl.length()=637 2019-11-25T09:31:26.496 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.462+0000 7f4e837fe700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-11-25T09:31:26.496 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.462+0000 7f4e837fe700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-25T09:31:26.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.886+0000 7f4eb525fec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-25T09:31:26.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.886+0000 7f4eb525fec0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-25T09:31:26.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.886+0000 7f4eb525fec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2019-11-25T09:31:26.933 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.900+0000 7f4e837fe700 10 RGWWatcher::handle_notify() notify_id 536870912003 cookie 94589227781776 notifier 4636 bl.length()=202 2019-11-25T09:31:26.933 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.900+0000 7f4e837fe700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-11-25T09:31:26.934 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:26.900+0000 7f4e837fe700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-11-25T09:31:27.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:27.419+0000 7f4eb525fec0 10 cache put: name=default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO info.flags=0x7 2019-11-25T09:31:27.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:27.419+0000 7f4eb525fec0 10 moving default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO to cache LRU end 2019-11-25T09:31:27.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:27.419+0000 7f4eb525fec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=190 2019-11-25T09:31:27.465 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:27.432+0000 7f4e837fe700 10 RGWWatcher::handle_notify() notify_id 536870912001 cookie 94589227783472 notifier 4636 bl.length()=190 2019-11-25T09:31:27.465 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:27.432+0000 7f4e837fe700 10 cache put: name=default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO info.flags=0x7 2019-11-25T09:31:27.465 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:27.432+0000 7f4e837fe700 10 moving default.rgw.meta+users.keys+FDHTKSXNTKHRSAZDQMFO to cache LRU end 2019-11-25T09:31:27.881 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2019-11-25T09:31:27.882 INFO:teuthology.orchestra.run.smithi135.stdout: "user_id": "ragweed.client.0", 2019-11-25T09:31:27.882 INFO:teuthology.orchestra.run.smithi135.stdout: "display_name": "Mr. ragweed.client.0", 2019-11-25T09:31:27.882 INFO:teuthology.orchestra.run.smithi135.stdout: "email": "ragweed.client.0+test@test.test", 2019-11-25T09:31:27.882 INFO:teuthology.orchestra.run.smithi135.stdout: "suspended": 0, 2019-11-25T09:31:27.882 INFO:teuthology.orchestra.run.smithi135.stdout: "max_buckets": 1000, 2019-11-25T09:31:27.882 INFO:teuthology.orchestra.run.smithi135.stdout: "subusers": [], 2019-11-25T09:31:27.883 INFO:teuthology.orchestra.run.smithi135.stdout: "keys": [ 2019-11-25T09:31:27.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2019-11-25T09:31:27.883 INFO:teuthology.orchestra.run.smithi135.stdout: "user": "ragweed.client.0", 2019-11-25T09:31:27.883 INFO:teuthology.orchestra.run.smithi135.stdout: "access_key": "FDHTKSXNTKHRSAZDQMFO", 2019-11-25T09:31:27.883 INFO:teuthology.orchestra.run.smithi135.stdout: "secret_key": "nqYVs6ib4o/xqaTtC2sWKzK1/iqT/J9yLUKNum8IetUOQaw8Ojc3WQ==" 2019-11-25T09:31:27.883 INFO:teuthology.orchestra.run.smithi135.stdout: } 2019-11-25T09:31:27.883 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2019-11-25T09:31:27.883 INFO:teuthology.orchestra.run.smithi135.stdout: "swift_keys": [], 2019-11-25T09:31:27.884 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": [], 2019-11-25T09:31:27.884 INFO:teuthology.orchestra.run.smithi135.stdout: "op_mask": "read, write, delete", 2019-11-25T09:31:27.884 INFO:teuthology.orchestra.run.smithi135.stdout: "system": "true", 2019-11-25T09:31:27.884 INFO:teuthology.orchestra.run.smithi135.stdout: "default_placement": "", 2019-11-25T09:31:27.885 INFO:teuthology.orchestra.run.smithi135.stdout: "default_storage_class": "", 2019-11-25T09:31:27.885 INFO:teuthology.orchestra.run.smithi135.stdout: "placement_tags": [], 2019-11-25T09:31:27.885 INFO:teuthology.orchestra.run.smithi135.stdout: "bucket_quota": { 2019-11-25T09:31:27.885 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T09:31:27.885 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T09:31:27.885 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T09:31:27.886 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T09:31:27.886 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T09:31:27.887 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T09:31:27.887 INFO:teuthology.orchestra.run.smithi135.stdout: "user_quota": { 2019-11-25T09:31:27.888 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T09:31:27.888 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T09:31:27.888 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T09:31:27.888 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T09:31:27.891 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T09:31:27.891 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T09:31:27.891 INFO:teuthology.orchestra.run.smithi135.stdout: "temp_url_keys": [], 2019-11-25T09:31:27.891 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "rgw", 2019-11-25T09:31:27.891 INFO:teuthology.orchestra.run.smithi135.stdout: "mfa_ids": [] 2019-11-25T09:31:27.891 INFO:teuthology.orchestra.run.smithi135.stdout:} 2019-11-25T09:31:27.892 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:27.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:27.894+0000 7f4eb525fec0 20 remove_watcher() i=0 2019-11-25T09:31:27.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:27.894+0000 7f4eb525fec0 2 removed watcher, disabling cache 2019-11-25T09:31:27.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:27.939+0000 7f4eb525fec0 20 remove_watcher() i=1 2019-11-25T09:31:28.022 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:27.988+0000 7f4eb525fec0 20 remove_watcher() i=2 2019-11-25T09:31:28.084 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:28.051+0000 7f4eb525fec0 20 remove_watcher() i=3 2019-11-25T09:31:28.118 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:28.085+0000 7f4eb525fec0 20 remove_watcher() i=4 2019-11-25T09:31:28.160 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:28.127+0000 7f4eb525fec0 20 remove_watcher() i=5 2019-11-25T09:31:28.228 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:28.195+0000 7f4eb525fec0 20 remove_watcher() i=6 2019-11-25T09:31:28.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:31:28.250+0000 7f4eb525fec0 20 remove_watcher() i=7 2019-11-25T09:31:28.293 INFO:tasks.ragweed:Configuring ragweed... 2019-11-25T09:31:28.293 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2019-11-25T09:31:34.983 INFO:teuthology.orchestra.run.smithi135.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-25T09:31:35.086 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T09:31:35.122 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T09:31:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T09:31:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T09:31:35.123 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T09:31:35.124 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T09:31:35.766 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T09:31:36.160 INFO:teuthology.orchestra.run.smithi135.stdout:Package python2-pip-8.1.2-10.el7.noarch already installed and latest version 2019-11-25T09:31:37.194 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T09:31:37.194 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:31:37.194 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package libevent-devel.x86_64 0:2.0.21-4.el7 will be installed 2019-11-25T09:31:37.196 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 will be installed 2019-11-25T09:31:37.199 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: xz-devel for package: libxml2-devel-2.9.1-6.el7_2.3.x86_64 2019-11-25T09:31:37.231 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package libxslt-devel.x86_64 0:1.1.28-5.el7 will be installed 2019-11-25T09:31:37.232 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libgcrypt-devel for package: libxslt-devel-1.1.28-5.el7.x86_64 2019-11-25T09:31:37.235 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-11-25T09:31:37.236 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:31:37.236 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package libgcrypt-devel.x86_64 0:1.5.3-14.el7 will be installed 2019-11-25T09:31:37.238 INFO:teuthology.orchestra.run.smithi135.stdout:--> Processing Dependency: libgpg-error-devel for package: libgcrypt-devel-1.5.3-14.el7.x86_64 2019-11-25T09:31:37.240 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package xz-devel.x86_64 0:5.2.2-1.el7 will be installed 2019-11-25T09:31:37.241 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T09:31:37.241 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package libgpg-error-devel.x86_64 0:1.12-3.el7 will be installed 2019-11-25T09:31:37.621 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T09:31:37.816 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:37.816 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T09:31:37.817 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:37.817 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:31:37.817 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2019-11-25T09:31:37.818 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:31:37.818 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T09:31:37.818 INFO:teuthology.orchestra.run.smithi135.stdout: libevent-devel x86_64 2.0.21-4.el7 base 85 k 2019-11-25T09:31:37.818 INFO:teuthology.orchestra.run.smithi135.stdout: libxml2-devel x86_64 2.9.1-6.el7_2.3 base 1.0 M 2019-11-25T09:31:37.818 INFO:teuthology.orchestra.run.smithi135.stdout: libxslt-devel x86_64 1.1.28-5.el7 base 309 k 2019-11-25T09:31:37.818 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.7-18.el7 base 50 k 2019-11-25T09:31:37.818 INFO:teuthology.orchestra.run.smithi135.stdout:Installing for dependencies: 2019-11-25T09:31:37.819 INFO:teuthology.orchestra.run.smithi135.stdout: libgcrypt-devel x86_64 1.5.3-14.el7 base 129 k 2019-11-25T09:31:37.819 INFO:teuthology.orchestra.run.smithi135.stdout: libgpg-error-devel x86_64 1.12-3.el7 base 16 k 2019-11-25T09:31:37.819 INFO:teuthology.orchestra.run.smithi135.stdout: xz-devel x86_64 5.2.2-1.el7 base 46 k 2019-11-25T09:31:37.819 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:37.819 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T09:31:37.819 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T09:31:37.819 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages (+3 Dependent packages) 2019-11-25T09:31:37.820 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:37.820 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 1.7 M 2019-11-25T09:31:37.820 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 12 M 2019-11-25T09:31:37.821 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T09:31:38.206 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2019-11-25T09:31:38.206 INFO:teuthology.orchestra.run.smithi135.stdout:Total 4.3 MB/s | 1.7 MB 00:00 2019-11-25T09:31:38.214 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T09:31:38.226 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T09:31:38.269 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T09:31:38.270 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T09:31:38.915 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgpg-error-devel-1.12-3.el7.x86_64 1/7 2019-11-25T09:31:39.245 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgcrypt-devel-1.5.3-14.el7.x86_64 2/7 2019-11-25T09:31:39.488 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-25T09:31:40.047 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xz-devel-5.2.2-1.el7.x86_64 4/7 2019-11-25T09:31:40.503 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libxml2-devel-2.9.1-6.el7_2.3.x86_64 5/7 2019-11-25T09:31:40.890 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libxslt-devel-1.1.28-5.el7.x86_64 6/7 2019-11-25T09:31:41.180 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libevent-devel-2.0.21-4.el7.x86_64 7/7 2019-11-25T09:31:41.262 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xz-devel-5.2.2-1.el7.x86_64 1/7 2019-11-25T09:31:41.379 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libxml2-devel-2.9.1-6.el7_2.3.x86_64 2/7 2019-11-25T09:31:41.496 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-11-25T09:31:41.588 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libxslt-devel-1.1.28-5.el7.x86_64 4/7 2019-11-25T09:31:41.700 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgpg-error-devel-1.12-3.el7.x86_64 5/7 2019-11-25T09:31:41.838 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libevent-devel-2.0.21-4.el7.x86_64 6/7 2019-11-25T09:31:42.323 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgcrypt-devel-1.5.3-14.el7.x86_64 7/7 2019-11-25T09:31:42.324 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:42.324 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T09:31:42.324 INFO:teuthology.orchestra.run.smithi135.stdout: libevent-devel.x86_64 0:2.0.21-4.el7 libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 2019-11-25T09:31:42.324 INFO:teuthology.orchestra.run.smithi135.stdout: libxslt-devel.x86_64 0:1.1.28-5.el7 zlib-devel.x86_64 0:1.2.7-18.el7 2019-11-25T09:31:42.324 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:42.324 INFO:teuthology.orchestra.run.smithi135.stdout:Dependency Installed: 2019-11-25T09:31:42.325 INFO:teuthology.orchestra.run.smithi135.stdout: libgcrypt-devel.x86_64 0:1.5.3-14.el7 libgpg-error-devel.x86_64 0:1.12-3.el7 2019-11-25T09:31:42.325 INFO:teuthology.orchestra.run.smithi135.stdout: xz-devel.x86_64 0:5.2.2-1.el7 2019-11-25T09:31:42.325 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:42.325 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T09:31:42.609 INFO:teuthology.orchestra.run.smithi135.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2019-11-25T09:31:44.327 INFO:teuthology.orchestra.run.smithi135.stdout:Installing setuptools, pip, wheel...done. 2019-11-25T09:31:44.947 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting pip 2019-11-25T09:31:45.048 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl (1.4MB) 2019-11-25T09:31:45.254 INFO:teuthology.orchestra.run.smithi135.stdout:Installing collected packages: pip 2019-11-25T09:31:45.254 INFO:teuthology.orchestra.run.smithi135.stdout: Found existing installation: pip 9.0.1 2019-11-25T09:31:45.319 INFO:teuthology.orchestra.run.smithi135.stdout: Uninstalling pip-9.0.1: 2019-11-25T09:31:45.362 INFO:teuthology.orchestra.run.smithi135.stdout: Successfully uninstalled pip-9.0.1 2019-11-25T09:31:45.935 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully installed pip-19.3.1 2019-11-25T09:31:46.699 INFO:teuthology.orchestra.run.smithi135.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-25T09:31:46.787 INFO:teuthology.orchestra.run.smithi135.stdout:Requirement already satisfied: six in /usr/lib/python2.7/site-packages (1.9.0) 2019-11-25T09:31:47.732 INFO:teuthology.orchestra.run.smithi135.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-25T09:31:47.954 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting nose 2019-11-25T09:31:48.000 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) 2019-11-25T09:31:48.108 INFO:teuthology.orchestra.run.smithi135.stdout:Installing collected packages: nose 2019-11-25T09:31:48.177 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully installed nose-1.3.7 2019-11-25T09:31:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-25T09:31:49.302 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting setuptools==32.3.1 2019-11-25T09:31:49.353 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479kB) 2019-11-25T09:31:49.531 INFO:teuthology.orchestra.run.smithi135.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-25T09:31:49.531 INFO:teuthology.orchestra.run.smithi135.stdout:Installing collected packages: setuptools 2019-11-25T09:31:49.531 INFO:teuthology.orchestra.run.smithi135.stdout: Found existing installation: setuptools 28.8.0 2019-11-25T09:31:49.545 INFO:teuthology.orchestra.run.smithi135.stdout: Uninstalling setuptools-28.8.0: 2019-11-25T09:31:49.560 INFO:teuthology.orchestra.run.smithi135.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-25T09:31:49.682 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully installed setuptools-32.3.1 2019-11-25T09:31:50.259 INFO:teuthology.orchestra.run.smithi135.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-25T09:31:50.640 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting PyYAML 2019-11-25T09:31:50.677 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/e3/e8/b3212641ee2718d556df0f23f78de8303f068fe29cdaa7a91018849582fe/PyYAML-5.1.2.tar.gz (265kB) 2019-11-25T09:31:51.378 INFO:teuthology.orchestra.run.smithi135.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python2.7/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2019-11-25T09:31:51.558 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting boto!=2.46.0,>=2.6.0 2019-11-25T09:31:51.567 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB) 2019-11-25T09:31:51.864 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting bunch>=1.0.0 2019-11-25T09:31:51.874 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz 2019-11-25T09:31:52.547 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting gevent>=1.0 2019-11-25T09:31:52.557 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl (5.0MB) 2019-11-25T09:31:52.996 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting httplib2 2019-11-25T09:31:53.005 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/ce/2e/87461bfbb7e561203b759b3f7f639e2144226604372830d00a8279960ae1/httplib2-0.14.0.tar.gz (219kB) 2019-11-25T09:31:54.309 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting lxml 2019-11-25T09:31:54.315 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/e4/f4/65d145cd6917131826050b0479be35aaccba2847b7f80fc4afc6bec6616b/lxml-4.4.1-cp27-cp27mu-manylinux1_x86_64.whl (5.7MB) 2019-11-25T09:31:54.785 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-25T09:31:54.794 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-25T09:31:54.845 INFO:teuthology.orchestra.run.smithi135.stdout:Building wheels for collected packages: PyYAML, bunch, httplib2 2019-11-25T09:31:54.845 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for PyYAML (setup.py): started 2019-11-25T09:31:55.605 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2019-11-25T09:31:55.606 INFO:teuthology.orchestra.run.smithi135.stdout: Created wheel for PyYAML: filename=PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl size=46204 sha256=e32b2233b0b6304b162fdf8477da28641b60b7f91d6d98ef834982731f40b51a 2019-11-25T09:31:55.606 INFO:teuthology.orchestra.run.smithi135.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030 2019-11-25T09:31:55.628 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for bunch (setup.py): started 2019-11-25T09:31:55.949 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for bunch (setup.py): finished with status 'done' 2019-11-25T09:31:55.950 INFO:teuthology.orchestra.run.smithi135.stdout: Created wheel for bunch: filename=bunch-1.0.1-cp27-none-any.whl size=8347 sha256=4720e566609762889a4071f0b1a0482d5943ae958d02e434ef4c0be4f1c63352 2019-11-25T09:31:55.950 INFO:teuthology.orchestra.run.smithi135.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c 2019-11-25T09:31:55.955 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for httplib2 (setup.py): started 2019-11-25T09:31:56.303 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for httplib2 (setup.py): finished with status 'done' 2019-11-25T09:31:56.304 INFO:teuthology.orchestra.run.smithi135.stdout: Created wheel for httplib2: filename=httplib2-0.14.0-cp27-none-any.whl size=96742 sha256=c541e18554361ef44f9b0cd6eb8cb1ca9e310c6f913db0ae89df9b573df592d8 2019-11-25T09:31:56.304 INFO:teuthology.orchestra.run.smithi135.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488 2019-11-25T09:31:56.311 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully built PyYAML bunch httplib2 2019-11-25T09:31:56.417 INFO:teuthology.orchestra.run.smithi135.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-11-25T09:31:56.417 INFO:teuthology.orchestra.run.smithi135.stdout:Installing collected packages: PyYAML, boto, bunch, greenlet, gevent, httplib2, lxml 2019-11-25T09:31:56.417 INFO:teuthology.orchestra.run.smithi135.stdout: Found existing installation: PyYAML 3.10 2019-11-25T09:31:56.418 INFO:teuthology.orchestra.run.smithi135.stdout: Not uninstalling pyyaml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-25T09:31:56.418 INFO:teuthology.orchestra.run.smithi135.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2019-11-25T09:31:57.503 INFO:teuthology.orchestra.run.smithi135.stdout: Found existing installation: lxml 3.2.1 2019-11-25T09:31:57.504 INFO:teuthology.orchestra.run.smithi135.stdout: Not uninstalling lxml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-11-25T09:31:57.504 INFO:teuthology.orchestra.run.smithi135.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2019-11-25T09:31:57.571 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 bunch-1.0.1 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 lxml-4.4.1 2019-11-25T09:31:57.933 INFO:teuthology.orchestra.run.smithi135.stdout:running develop 2019-11-25T09:31:57.997 INFO:teuthology.orchestra.run.smithi135.stdout:running egg_info 2019-11-25T09:31:57.998 INFO:teuthology.orchestra.run.smithi135.stdout:creating ragweed.egg-info 2019-11-25T09:31:57.998 INFO:teuthology.orchestra.run.smithi135.stdout:writing requirements to ragweed.egg-info/requires.txt 2019-11-25T09:31:57.998 INFO:teuthology.orchestra.run.smithi135.stdout:writing ragweed.egg-info/PKG-INFO 2019-11-25T09:31:57.998 INFO:teuthology.orchestra.run.smithi135.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2019-11-25T09:31:57.998 INFO:teuthology.orchestra.run.smithi135.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2019-11-25T09:31:57.998 INFO:teuthology.orchestra.run.smithi135.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-25T09:31:57.999 INFO:teuthology.orchestra.run.smithi135.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-25T09:31:57.999 INFO:teuthology.orchestra.run.smithi135.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-11-25T09:31:58.000 INFO:teuthology.orchestra.run.smithi135.stdout:running build_ext 2019-11-25T09:31:58.007 INFO:teuthology.orchestra.run.smithi135.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/ragweed.egg-link (link to .) 2019-11-25T09:31:58.007 INFO:teuthology.orchestra.run.smithi135.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2019-11-25T09:31:58.008 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:58.008 INFO:teuthology.orchestra.run.smithi135.stdout:Installed /home/ubuntu/cephtest/ragweed 2019-11-25T09:31:58.008 INFO:teuthology.orchestra.run.smithi135.stdout:Processing dependencies for ragweed==0.0.1 2019-11-25T09:31:58.008 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for isodate>=0.4.4 2019-11-25T09:31:58.009 INFO:teuthology.orchestra.run.smithi135.stdout:Reading https://pypi.python.org/simple/isodate/ 2019-11-25T09:31:58.093 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading https://files.pythonhosted.org/packages/b1/80/fb8c13a4cd38eb5021dc3741a9e588e4d1de88d895c1910c6fc8a08b7a70/isodate-0.6.0.tar.gz#sha256=2e364a3d5759479cdb2d37cce6b9376ea504db2ff90252a2e5b7cc89cc9ff2d8 2019-11-25T09:31:58.149 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: isodate 0.6.0 2019-11-25T09:31:58.149 INFO:teuthology.orchestra.run.smithi135.stdout:Processing isodate-0.6.0.tar.gz 2019-11-25T09:31:58.158 INFO:teuthology.orchestra.run.smithi135.stdout:Writing /tmp/easy_install-6Gn8p3/isodate-0.6.0/setup.cfg 2019-11-25T09:31:58.159 INFO:teuthology.orchestra.run.smithi135.stdout:Running isodate-0.6.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-6Gn8p3/isodate-0.6.0/egg-dist-tmp-zbuYNJ 2019-11-25T09:31:58.469 INFO:teuthology.orchestra.run.smithi135.stderr:zip_safe flag not set; analyzing archive contents... 2019-11-25T09:31:58.483 INFO:teuthology.orchestra.run.smithi135.stdout:Moving isodate-0.6.0-py2.7.egg to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-25T09:31:58.484 INFO:teuthology.orchestra.run.smithi135.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-25T09:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:58.485 INFO:teuthology.orchestra.run.smithi135.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/isodate-0.6.0-py2.7.egg 2019-11-25T09:31:58.508 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for gevent==1.4.0 2019-11-25T09:31:58.508 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: gevent 1.4.0 2019-11-25T09:31:58.508 INFO:teuthology.orchestra.run.smithi135.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-25T09:31:58.509 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:58.509 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-25T09:31:58.510 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for bunch==1.0.1 2019-11-25T09:31:58.510 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: bunch 1.0.1 2019-11-25T09:31:58.510 INFO:teuthology.orchestra.run.smithi135.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-25T09:31:58.510 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:58.510 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-25T09:31:58.511 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for PyYAML==5.1.2 2019-11-25T09:31:58.512 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: PyYAML 5.1.2 2019-11-25T09:31:58.512 INFO:teuthology.orchestra.run.smithi135.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-25T09:31:58.512 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:58.512 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-25T09:31:58.512 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for boto==2.49.0 2019-11-25T09:31:58.512 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: boto 2.49.0 2019-11-25T09:31:58.512 INFO:teuthology.orchestra.run.smithi135.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-25T09:31:58.513 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:58.513 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-25T09:31:58.513 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for six==1.9.0 2019-11-25T09:31:58.514 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: six 1.9.0 2019-11-25T09:31:58.514 INFO:teuthology.orchestra.run.smithi135.stdout:Adding six 1.9.0 to easy-install.pth file 2019-11-25T09:31:58.514 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:58.514 INFO:teuthology.orchestra.run.smithi135.stdout:Using /usr/lib/python2.7/site-packages 2019-11-25T09:31:58.520 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for greenlet==0.4.15 2019-11-25T09:31:58.520 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: greenlet 0.4.15 2019-11-25T09:31:58.521 INFO:teuthology.orchestra.run.smithi135.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-25T09:31:58.521 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:31:58.521 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-11-25T09:31:58.521 INFO:teuthology.orchestra.run.smithi135.stdout:Finished processing dependencies for ragweed==0.0.1 2019-11-25T09:31:58.537 INFO:teuthology.orchestra.run.smithi135:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2019-11-25T09:31:58.618 INFO:tasks.ragweed:Configuring boto... 2019-11-25T09:31:58.618 INFO:teuthology.orchestra.run.smithi135:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-25T09:31:58.761 INFO:teuthology.orchestra.run.smithi135:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2019-11-25T09:32:40.726 INFO:teuthology.orchestra.run.smithi135.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2019-11-25T09:33:06.731 INFO:teuthology.orchestra.run.smithi135.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2019-11-25T09:33:29.952 INFO:teuthology.orchestra.run.smithi135.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2019-11-25T09:33:53.464 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:09:06.687 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:33:53.509 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:09:06.731 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:33:53.565 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:09:06.788 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:33:53.565 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:09:06.817 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:33:53.570 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:09:06.792 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:33:53.636 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:09:06.895 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:33:54.092 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:09:07.315 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:33:54.161 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:09:07.384 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:33:54.396 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:09:07.652 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:33:57.109 INFO:teuthology.orchestra.run.smithi135.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2019-11-25T09:34:24.210 INFO:teuthology.orchestra.run.smithi135.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2019-11-25T09:35:40.543 INFO:teuthology.orchestra.run.smithi135.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2019-11-25T09:36:08.921 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:11:22.135 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:36:08.930 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:11:22.144 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:36:08.943 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:11:22.157 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:36:08.949 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:11:22.163 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:36:08.955 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:11:22.215 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:36:08.966 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:11:22.227 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:36:09.064 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:11:22.278 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:36:09.080 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:11:22.294 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:36:09.145 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:11:22.406 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:36:40.999 INFO:teuthology.orchestra.run.smithi135.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2019-11-25T09:38:25.209 INFO:teuthology.orchestra.run.smithi135.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2019-11-25T09:39:04.436 INFO:teuthology.orchestra.run.smithi135.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2019-11-25T09:39:04.437 INFO:teuthology.orchestra.run.smithi135.stderr: 2019-11-25T09:39:04.438 INFO:teuthology.orchestra.run.smithi135.stderr:---------------------------------------------------------------------- 2019-11-25T09:39:04.438 INFO:teuthology.orchestra.run.smithi135.stderr:Ran 9 tests in 425.066s 2019-11-25T09:39:04.438 INFO:teuthology.orchestra.run.smithi135.stderr: 2019-11-25T09:39:04.438 INFO:teuthology.orchestra.run.smithi135.stderr:OK 2019-11-25T09:39:04.470 INFO:tasks.ragweed:Cleaning up boto... 2019-11-25T09:39:04.470 INFO:teuthology.orchestra.run.smithi135:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-25T09:39:04.515 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2019-11-25T09:39:04.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.573+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.670 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.605+0000 7f8bbb2efec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:04.670 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.605+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.680 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.616+0000 7f8bbb2efec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:04.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.616+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.691 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.627+0000 7f8bbb2efec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:04.691 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.627+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.714 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.649+0000 7f8bbb2efec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:04.900 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.835+0000 7f8bbb2efec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T09:39:04.900 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.835+0000 7f8bbb2efec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T09:39:04.900 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.835+0000 7f8bbb2efec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T09:39:04.900 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.835+0000 7f8bbb2efec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T09:39:04.901 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.835+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.910 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.845+0000 7f8bbb2efec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:04.910 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.845+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.856+0000 7f8bbb2efec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:39:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.856+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.865+0000 7f8bbb2efec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:04.930 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.865+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.951 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.887+0000 7f8bbb2efec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:39:04.951 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.887+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.956 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.892+0000 7f8bbb2efec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:04.956 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.892+0000 7f8bbb2efec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T09:39:04.957 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.892+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.965 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.901+0000 7f8bbb2efec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:04.965 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.901+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.974 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.910+0000 7f8bbb2efec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:04.974 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.910+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.982 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.918+0000 7f8bbb2efec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:39:04.982 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.918+0000 7f8bbb2efec0 20 zonegroup default 2019-11-25T09:39:04.983 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.918+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.924+0000 7f8bbb2efec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:04.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.924+0000 7f8bbb2efec0 10 Cannot find current period zone using local zone 2019-11-25T09:39:04.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.924+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:04.994 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.929+0000 7f8bbb2efec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:04.994 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.929+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:05.003 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.939+0000 7f8bbb2efec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:05.004 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.939+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:05.013 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.949+0000 7f8bbb2efec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:39:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.949+0000 7f8bbb2efec0 20 zone default found 2019-11-25T09:39:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.949+0000 7f8bbb2efec0 20 started sync module instance, tier type = 2019-11-25T09:39:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:04.949+0000 7f8bbb2efec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T09:39:05.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.336+0000 7f8bbb2efec0 20 add_watcher() i=0 2019-11-25T09:39:05.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.336+0000 7f8bbb2efec0 20 add_watcher() i=1 2019-11-25T09:39:05.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.336+0000 7f8bbb2efec0 20 add_watcher() i=2 2019-11-25T09:39:05.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.336+0000 7f8bbb2efec0 20 add_watcher() i=3 2019-11-25T09:39:05.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.336+0000 7f8bbb2efec0 20 add_watcher() i=4 2019-11-25T09:39:05.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.336+0000 7f8bbb2efec0 20 add_watcher() i=5 2019-11-25T09:39:05.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.336+0000 7f8bbb2efec0 20 add_watcher() i=6 2019-11-25T09:39:05.430 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.365+0000 7f8bbb2efec0 20 add_watcher() i=7 2019-11-25T09:39:05.430 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.365+0000 7f8bbb2efec0 2 all 8 watchers are set, enabling cache 2019-11-25T09:39:05.431 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.366+0000 7f8b78fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T09:39:05.431 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.366+0000 7f8ba8d1e700 0 -- >> v1:172.21.15.174:6789/0 conn(0x55a56ddb8020 legacy=0x55a56ddbb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-25T09:39:05.477 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:05.412+0000 7f8ba851d700 0 -- 172.21.15.135:0/1025370073 >> [v2:172.21.15.174:6800/8260,v1:172.21.15.174:6801/8260] conn(0x7f8aec0175b0 msgr2=0x7f8aec019a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-25T09:39:06.872 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.807+0000 7f8aeaffd700 20 reqs_thread_entry: start 2019-11-25T09:39:06.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.808+0000 7f8ae8ff9700 20 reqs_thread_entry: start 2019-11-25T09:39:06.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.808+0000 7f8bbb2efec0 20 init_complete bucket index max shards: 0 2019-11-25T09:39:06.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.809+0000 7f8adeffd700 20 reqs_thread_entry: start 2019-11-25T09:39:06.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.809+0000 7f8bbb2efec0 20 get_system_obj_state: rctx=0x7ffeaf694448 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x55a56de3b1a0 s->prefetch_data=0 2019-11-25T09:39:06.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.809+0000 7f8bbb2efec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-11-25T09:39:06.890 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.826+0000 7f8bbb2efec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2019-11-25T09:39:06.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.826+0000 7f8bbb2efec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-25T09:39:06.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.826+0000 7f8bbb2efec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:06.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.826+0000 7f8bbb2efec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:06.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.826+0000 7f8bbb2efec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-25T09:39:06.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.826+0000 7f8bbb2efec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.843+0000 7f8bbb2efec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-25T09:39:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.843+0000 7f8bbb2efec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2019-11-25T09:39:06.908 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.843+0000 7f8bbb2efec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-11-25T09:39:06.918 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.854+0000 7f8bbb2efec0 10 removing key index: AAGJSFGJUKFDMDMQNIYF 2019-11-25T09:39:06.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.854+0000 7f8bbb2efec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=170 2019-11-25T09:39:06.932 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:06.867+0000 7f8b9dffb700 10 RGWWatcher::handle_notify() notify_id 575525617667 cookie 94169000976928 notifier 4698 bl.length()=170 2019-11-25T09:39:07.383 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:07.314+0000 7f8bbb2efec0 10 removing email index: sysuser.client.0+test@test.test 2019-11-25T09:39:07.383 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:07.314+0000 7f8bbb2efec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2019-11-25T09:39:07.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:07.332+0000 7f8b9dffb700 10 RGWWatcher::handle_notify() notify_id 575525617668 cookie 94169000978384 notifier 4698 bl.length()=182 2019-11-25T09:39:07.706 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:07.642+0000 7f8bbb2efec0 10 removing user buckets index 2019-11-25T09:39:07.707 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:07.642+0000 7f8bbb2efec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2019-11-25T09:39:07.719 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:07.655+0000 7f8b9dffb700 10 RGWWatcher::handle_notify() notify_id 575525617668 cookie 94169000976928 notifier 4698 bl.length()=173 2019-11-25T09:39:07.812 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:07.747+0000 7f8bbb2efec0 10 removing user index: sysuser.client.0 2019-11-25T09:39:07.812 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:07.747+0000 7f8bbb2efec0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2019-11-25T09:39:07.812 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:07.747+0000 7f8bbb2efec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2019-11-25T09:39:07.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:07.766+0000 7f8b9dffb700 10 RGWWatcher::handle_notify() notify_id 575525617669 cookie 94169000974528 notifier 4698 bl.length()=165 2019-11-25T09:39:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.262+0000 7f8bbb2efec0 20 remove_watcher() i=0 2019-11-25T09:39:08.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.262+0000 7f8bbb2efec0 2 removed watcher, disabling cache 2019-11-25T09:39:08.392 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.328+0000 7f8bbb2efec0 20 remove_watcher() i=1 2019-11-25T09:39:08.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.387+0000 7f8bbb2efec0 20 remove_watcher() i=2 2019-11-25T09:39:08.497 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.432+0000 7f8bbb2efec0 20 remove_watcher() i=3 2019-11-25T09:39:08.544 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.479+0000 7f8bbb2efec0 20 remove_watcher() i=4 2019-11-25T09:39:08.600 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.536+0000 7f8bbb2efec0 20 remove_watcher() i=5 2019-11-25T09:39:08.640 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.576+0000 7f8bbb2efec0 20 remove_watcher() i=6 2019-11-25T09:39:08.673 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.608+0000 7f8bbb2efec0 20 remove_watcher() i=7 2019-11-25T09:39:08.680 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2019-11-25T09:39:08.798 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.733+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:08.830 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.766+0000 7f4ec5257ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:08.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.766+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:08.841 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.776+0000 7f4ec5257ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:08.842 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.776+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:08.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.787+0000 7f4ec5257ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:08.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.788+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:08.877 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:08.813+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:09.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.063+0000 7f4ec5257ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T09:39:09.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.063+0000 7f4ec5257ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T09:39:09.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.063+0000 7f4ec5257ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T09:39:09.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.063+0000 7f4ec5257ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T09:39:09.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.063+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.145 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.081+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:09.146 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.081+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.164 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.100+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:39:09.165 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.100+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.179 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.115+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:09.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.115+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.127+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:39:09.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.127+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.198 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.133+0000 7f4ec5257ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:09.198 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.133+0000 7f4ec5257ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T09:39:09.198 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.133+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.208 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.143+0000 7f4ec5257ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:09.208 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.143+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.155+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:09.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.155+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.168+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:39:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.168+0000 7f4ec5257ec0 20 zonegroup default 2019-11-25T09:39:09.233 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.168+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.176+0000 7f4ec5257ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:09.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.176+0000 7f4ec5257ec0 10 Cannot find current period zone using local zone 2019-11-25T09:39:09.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.176+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.247 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.183+0000 7f4ec5257ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:09.247 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.183+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.259 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.194+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:09.259 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.194+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:09.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.204+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:39:09.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.204+0000 7f4ec5257ec0 20 zone default found 2019-11-25T09:39:09.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.204+0000 7f4ec5257ec0 20 started sync module instance, tier type = 2019-11-25T09:39:09.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.204+0000 7f4ec5257ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T09:39:09.564 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.499+0000 7f4ec5257ec0 20 add_watcher() i=0 2019-11-25T09:39:09.564 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.499+0000 7f4ec5257ec0 20 add_watcher() i=1 2019-11-25T09:39:09.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.499+0000 7f4ec5257ec0 20 add_watcher() i=2 2019-11-25T09:39:09.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.499+0000 7f4ec5257ec0 20 add_watcher() i=3 2019-11-25T09:39:09.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.499+0000 7f4ec5257ec0 20 add_watcher() i=4 2019-11-25T09:39:09.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.499+0000 7f4ec5257ec0 20 add_watcher() i=5 2019-11-25T09:39:09.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.499+0000 7f4ec5257ec0 20 add_watcher() i=6 2019-11-25T09:39:09.598 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.532+0000 7f4ec5257ec0 20 add_watcher() i=7 2019-11-25T09:39:09.598 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.532+0000 7f4ec5257ec0 2 all 8 watchers are set, enabling cache 2019-11-25T09:39:09.599 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.532+0000 7f4e82fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T09:39:09.599 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.535+0000 7f4eb1c84700 0 -- 172.21.15.135:0/3119507679 >> v2:172.21.15.135:3300/0 conn(0x5592ebd55470 msgr2=0x5592ebd57980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T09:39:09.644 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:09.579+0000 7f4eb2485700 0 -- 172.21.15.135:0/3846122025 >> [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] conn(0x5592ebd66610 msgr2=0x5592ebd68a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T09:39:11.386 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.320+0000 7f4df17fa700 20 reqs_thread_entry: start 2019-11-25T09:39:11.386 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.320+0000 7f4deaffd700 20 reqs_thread_entry: start 2019-11-25T09:39:11.386 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.320+0000 7f4ec5257ec0 20 init_complete bucket index max shards: 0 2019-11-25T09:39:11.387 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.321+0000 7f4de97fa700 20 reqs_thread_entry: start 2019-11-25T09:39:11.387 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.321+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281e98 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x5592ebdcfde0 s->prefetch_data=0 2019-11-25T09:39:11.387 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.321+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-11-25T09:39:11.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.333+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2019-11-25T09:39:11.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.333+0000 7f4ec5257ec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-25T09:39:11.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.333+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:11.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.333+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:11.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.333+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-25T09:39:11.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.333+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:11.412 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.347+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=448 2019-11-25T09:39:11.413 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.347+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2019-11-25T09:39:11.413 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.347+0000 7f4ec5257ec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-11-25T09:39:11.431 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.365+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-conf state=0x5592ebdd1700 s->prefetch_data=0 2019-11-25T09:39:11.432 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.365+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2019-11-25T09:39:11.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.379+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2019-11-25T09:39:11.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.379+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-25T09:39:11.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.379+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:11.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.379+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:11.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.379+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:11.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.379+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:11.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.389+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=200 2019-11-25T09:39:11.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.389+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2019-11-25T09:39:11.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.389+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-25T09:39:11.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.389+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 state=0x5592ebdd3cc0 s->prefetch_data=0 2019-11-25T09:39:11.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.389+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 : miss 2019-11-25T09:39:11.472 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.405+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 info.flags=0x16 2019-11-25T09:39:11.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.405+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 to cache LRU end 2019-11-25T09:39:11.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.405+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:11.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.405+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:11.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.405+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:11.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.405+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:11.474 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.405+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:11.474 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.405+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:11.474 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.405+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:11.492 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.425+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=292 2019-11-25T09:39:11.492 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.425+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 info.flags=0x13 2019-11-25T09:39:11.496 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.425+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 to cache LRU end 2019-11-25T09:39:11.497 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.425+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:11.497 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.425+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:11.498 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.426+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 2019-11-25T09:39:11.529 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.463+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-conf[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1]) start [] num_entries 1100 2019-11-25T09:39:11.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.556+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2019-11-25T09:39:11.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.556+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2019-11-25T09:39:11.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.556+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2019-11-25T09:39:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.556+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2019-11-25T09:39:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.556+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2019-11-25T09:39:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.556+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2019-11-25T09:39:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.556+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2019-11-25T09:39:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.556+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2019-11-25T09:39:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.556+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2019-11-25T09:39:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.556+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:11.637 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.570+0000 7f4ec5257ec0 10 manifest: total_size = 3907 2019-11-25T09:39:11.637 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.570+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.13 2019-11-25T09:39:11.637 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.570+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:11.637 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.570+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8ec8 2019-11-25T09:39:11.637 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.571+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 2019-11-25T09:39:11.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.789+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:11.883 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.817+0000 7f4ec5257ec0 10 manifest: total_size = 5853 2019-11-25T09:39:11.884 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.817+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.30 2019-11-25T09:39:11.884 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.817+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:11.884 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.817+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8ec8 2019-11-25T09:39:11.884 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:11.817+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 2019-11-25T09:39:12.090 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.024+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:12.111 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.045+0000 7f4ec5257ec0 10 manifest: total_size = 3808 2019-11-25T09:39:12.111 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.045+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.56 2019-11-25T09:39:12.112 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.045+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:12.112 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.045+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8ec8 2019-11-25T09:39:12.112 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.045+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 2019-11-25T09:39:12.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.293+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:12.377 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.311+0000 7f4ec5257ec0 10 manifest: total_size = 9701 2019-11-25T09:39:12.378 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.311+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.72 2019-11-25T09:39:12.378 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.311+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:12.378 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.311+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8ec8 2019-11-25T09:39:12.378 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.311+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 2019-11-25T09:39:12.518 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.453+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:12.531 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.466+0000 7f4ec5257ec0 10 manifest: total_size = 10467 2019-11-25T09:39:12.532 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.466+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.87 2019-11-25T09:39:12.532 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.466+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:12.532 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.466+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8ec8 2019-11-25T09:39:12.532 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.466+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 2019-11-25T09:39:12.739 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.674+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:12.756 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.690+0000 7f4ec5257ec0 10 manifest: total_size = 3982 2019-11-25T09:39:12.756 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.690+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.120 2019-11-25T09:39:12.756 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.690+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:12.756 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.690+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8ec8 2019-11-25T09:39:12.756 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.690+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 2019-11-25T09:39:12.964 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.898+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:13.013 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.948+0000 7f4ec5257ec0 10 manifest: total_size = 4110 2019-11-25T09:39:13.013 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.948+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.189 2019-11-25T09:39:13.013 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.948+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:13.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.948+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8ec8 2019-11-25T09:39:13.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:12.948+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 2019-11-25T09:39:13.159 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.094+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:13.178 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.112+0000 7f4ec5257ec0 10 manifest: total_size = 12945 2019-11-25T09:39:13.178 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.112+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.246 2019-11-25T09:39:13.178 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.112+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:13.178 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.112+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8ec8 2019-11-25T09:39:13.178 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.112+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 2019-11-25T09:39:13.445 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.380+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:13.457 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.392+0000 7f4ec5257ec0 10 manifest: total_size = 6025 2019-11-25T09:39:13.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.392+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.322 2019-11-25T09:39:13.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.392+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x5592ebdd8ec8 s->prefetch_data=0 2019-11-25T09:39:13.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.392+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8ec8 2019-11-25T09:39:13.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.392+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 2019-11-25T09:39:13.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.660+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-conf[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1]) start _multipart_[] num_entries 1001 2019-11-25T09:39:13.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.660+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:13.823 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.758+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.848+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-conf state=0x5592ebdd97f0 s->prefetch_data=0 2019-11-25T09:39:13.913 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.848+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:13.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.863+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2019-11-25T09:39:13.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.863+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-11-25T09:39:13.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.863+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:13.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.863+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:13.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.863+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:13.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.863+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2019-11-25T09:39:13.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.863+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2019-11-25T09:39:13.984 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:13.918+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617664 cookie 94089510111744 notifier 4484 bl.length()=162 2019-11-25T09:39:14.138 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.073+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.1 from cache 2019-11-25T09:39:14.138 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.073+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=219 2019-11-25T09:39:14.160 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.093+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617665 cookie 94089510127328 notifier 4484 bl.length()=219 2019-11-25T09:39:14.533 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.467+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x5592ebdd97f0 s->prefetch_data=0 2019-11-25T09:39:14.533 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.467+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2019-11-25T09:39:14.543 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.478+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2019-11-25T09:39:14.543 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.478+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-25T09:39:14.543 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.478+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:14.544 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.478+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:14.544 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.478+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:14.544 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.478+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:14.558 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.493+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=229 2019-11-25T09:39:14.558 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.493+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2019-11-25T09:39:14.558 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.493+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-25T09:39:14.558 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.493+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2 state=0x5592ebdd1700 s->prefetch_data=0 2019-11-25T09:39:14.559 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.493+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2 : miss 2019-11-25T09:39:14.578 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.513+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2 info.flags=0x16 2019-11-25T09:39:14.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.513+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2 to cache LRU end 2019-11-25T09:39:14.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.513+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:14.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.513+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:14.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.513+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:14.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.513+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:14.580 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.513+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:14.580 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.513+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:14.580 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.513+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:14.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.539+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=321 2019-11-25T09:39:14.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.539+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2 info.flags=0x13 2019-11-25T09:39:14.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.539+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2 to cache LRU end 2019-11-25T09:39:14.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.539+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:14.605 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.539+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:14.605 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.539+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2 2019-11-25T09:39:14.637 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.572+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2]) start [] num_entries 1100 2019-11-25T09:39:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.635+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-25T09:39:14.702 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.636+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:14.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.654+0000 7f4ec5257ec0 10 manifest: total_size = 18874368 2019-11-25T09:39:14.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.654+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.20 2019-11-25T09:39:14.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.654+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:14.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.654+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:14.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.654+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2 2019-11-25T09:39:14.913 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:14.913 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:14.914 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:14.914 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:14.914 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:14.914 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:14.914 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:14.914 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:14.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:14.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:14.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:14.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2019-11-25T09:39:14.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:14.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2019-11-25T09:39:14.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=14675968 stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2019-11-25T09:39:14.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:14.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=18866176 part_ofs=10485760 rule->part_size=5242880 2019-11-25T09:39:14.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2019-11-25T09:39:14.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2019-11-25T09:39:14.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=19918848 part_ofs=15728640 rule->part_size=3145728 2019-11-25T09:39:14.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2019-11-25T09:39:14.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.848+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.20 2019-11-25T09:39:15.033 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.968+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-complete.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2]) start _multipart_[] num_entries 1001 2019-11-25T09:39:15.033 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:14.968+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:15.073 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.000+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:15.141 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.076+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x5592ebdd9cd0 s->prefetch_data=0 2019-11-25T09:39:15.141 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.076+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.088+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2019-11-25T09:39:15.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.088+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-11-25T09:39:15.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.088+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:15.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.088+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:15.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.088+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:15.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.088+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2019-11-25T09:39:15.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.088+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2019-11-25T09:39:15.242 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.176+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617664 cookie 94089510115072 notifier 4484 bl.length()=191 2019-11-25T09:39:15.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.434+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2 from cache 2019-11-25T09:39:15.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.434+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=248 2019-11-25T09:39:15.519 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.454+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617670 cookie 94089510117984 notifier 4484 bl.length()=248 2019-11-25T09:39:16.065 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.993+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x5592ebdd9f60 s->prefetch_data=0 2019-11-25T09:39:16.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:15.993+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2019-11-25T09:39:16.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.019+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2019-11-25T09:39:16.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.019+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-25T09:39:16.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.019+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:16.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.019+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:16.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.019+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:16.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.019+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:16.104 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.039+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=236 2019-11-25T09:39:16.104 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.039+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2019-11-25T09:39:16.104 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.039+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-25T09:39:16.105 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.039+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3 state=0x5592ebdd97f0 s->prefetch_data=0 2019-11-25T09:39:16.105 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.039+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3 : miss 2019-11-25T09:39:16.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.062+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3 info.flags=0x16 2019-11-25T09:39:16.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.062+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3 to cache LRU end 2019-11-25T09:39:16.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.062+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:16.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.062+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:16.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.062+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:16.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.062+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:16.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.062+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:16.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.062+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:16.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.062+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:16.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.090+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=328 2019-11-25T09:39:16.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.090+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3 info.flags=0x13 2019-11-25T09:39:16.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.090+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3 to cache LRU end 2019-11-25T09:39:16.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.090+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:16.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.090+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:16.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.090+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3 2019-11-25T09:39:16.200 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.135+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3]) start [] num_entries 1100 2019-11-25T09:39:16.270 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.205+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-25T09:39:16.270 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.205+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x5592ebdde9d8 s->prefetch_data=0 2019-11-25T09:39:16.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.219+0000 7f4ec5257ec0 10 manifest: total_size = 74198 2019-11-25T09:39:16.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.219+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.40 2019-11-25T09:39:16.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.219+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x5592ebdde9d8 s->prefetch_data=0 2019-11-25T09:39:16.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.219+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdde9d8 2019-11-25T09:39:16.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.219+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3 2019-11-25T09:39:16.431 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-25T09:39:16.432 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2019-11-25T09:39:16.432 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2019-11-25T09:39:16.432 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-25T09:39:16.432 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2019-11-25T09:39:16.432 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2019-11-25T09:39:16.432 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2019-11-25T09:39:16.432 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=20613 2019-11-25T09:39:16.433 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2019-11-25T09:39:16.433 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2019-11-25T09:39:16.433 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4252047 part_ofs=61839 rule->part_size=12359 2019-11-25T09:39:16.433 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2019-11-25T09:39:16.433 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.366+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.40 2019-11-25T09:39:16.529 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.464+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-update-complete.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3]) start _multipart_[] num_entries 1001 2019-11-25T09:39:16.529 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.464+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:16.564 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.499+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:16.687 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.622+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x5592ebdd9f60 s->prefetch_data=0 2019-11-25T09:39:16.688 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.622+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:16.704 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.639+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2019-11-25T09:39:16.705 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.639+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-11-25T09:39:16.705 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.639+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:16.705 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.639+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:16.705 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.639+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:16.705 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.639+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2019-11-25T09:39:16.705 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.639+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2019-11-25T09:39:16.723 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:16.657+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617671 cookie 94089510117984 notifier 4484 bl.length()=198 2019-11-25T09:39:18.035 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:17.970+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3 from cache 2019-11-25T09:39:18.036 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:17.970+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=255 2019-11-25T09:39:18.053 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:17.987+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617665 cookie 94089510115072 notifier 4484 bl.length()=255 2019-11-25T09:39:18.699 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.634+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x5592ebdda180 s->prefetch_data=0 2019-11-25T09:39:18.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.634+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2019-11-25T09:39:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.644+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2019-11-25T09:39:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.644+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-25T09:39:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.644+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.644+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.644+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:18.710 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.644+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:18.718 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.652+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=231 2019-11-25T09:39:18.718 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.652+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2019-11-25T09:39:18.718 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.652+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-25T09:39:18.718 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.652+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 state=0x5592ebdd97f0 s->prefetch_data=0 2019-11-25T09:39:18.718 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.652+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 : miss 2019-11-25T09:39:18.731 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.666+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 info.flags=0x16 2019-11-25T09:39:18.731 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.666+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 to cache LRU end 2019-11-25T09:39:18.731 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.666+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:18.732 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.666+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:18.732 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.666+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:18.732 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.666+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:18.732 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.666+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:18.732 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.666+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:18.732 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.666+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:18.748 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.683+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=323 2019-11-25T09:39:18.748 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.683+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 info.flags=0x13 2019-11-25T09:39:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.683+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 to cache LRU end 2019-11-25T09:39:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.683+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.683+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.683+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 2019-11-25T09:39:18.800 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.735+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4]) start [] num_entries 1100 2019-11-25T09:39:18.877 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.812+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo[03PYB3ggO.HnWUWosnbx1BHk1sx931o] 2019-11-25T09:39:18.878 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.812+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 2019-11-25T09:39:18.902 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.836+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.853+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to f4ek2jjmyagifz3a6xm5x28g7z8x6f9x 2019-11-25T09:39:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.853+0000 7f4ec5257ec0 20 get_obj_state_impl: setting s->olh_tag to bz02dzxre0exc2io3klec1bc7px68d70 2019-11-25T09:39:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.853+0000 7f4ec5257ec0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bz02dzxre0exc2io3klec1bc7px68d70 2019-11-25T09:39:18.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:18.927+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 2019-11-25T09:39:19.103 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.037+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 2019-11-25T09:39:19.103 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.037+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 2019-11-25T09:39:19.139 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.073+0000 7f4ec5257ec0 20 olh_log_entry: op=2 key=[] 2019-11-25T09:39:19.139 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.073+0000 7f4ec5257ec0 20 olh_log_entry: op=3 key=foo[03PYB3ggO.HnWUWosnbx1BHk1sx931o] 2019-11-25T09:39:19.139 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.073+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-multipart-index-versioning.1:_:03PYB3ggO.HnWUWosnbx1BHk1sx931o_foo state=0x5592ebde5d78 s->prefetch_data=0 2019-11-25T09:39:19.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.091+0000 7f4ec5257ec0 10 manifest: total_size = 1848 2019-11-25T09:39:19.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.091+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.55 2019-11-25T09:39:19.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.091+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-multipart-index-versioning.1:_:03PYB3ggO.HnWUWosnbx1BHk1sx931o_foo state=0x5592ebde5d78 s->prefetch_data=0 2019-11-25T09:39:19.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.091+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebde5d78 2019-11-25T09:39:19.158 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.091+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 2019-11-25T09:39:19.344 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-25T09:39:19.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=515 2019-11-25T09:39:19.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-11-25T09:39:19.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-25T09:39:19.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4190723 part_ofs=515 rule->part_size=515 2019-11-25T09:39:19.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-11-25T09:39:19.346 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-25T09:39:19.346 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4191238 part_ofs=1030 rule->part_size=515 2019-11-25T09:39:19.346 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-11-25T09:39:19.346 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-11-25T09:39:19.346 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4191753 part_ofs=1545 rule->part_size=303 2019-11-25T09:39:19.346 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-11-25T09:39:19.347 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.278+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.55 2019-11-25T09:39:19.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.403+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 2019-11-25T09:39:19.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.403+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 2019-11-25T09:39:19.602 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.537+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 2019-11-25T09:39:19.695 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.629+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 2019-11-25T09:39:19.695 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.629+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-index-versioning.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4]) start _multipart_[] num_entries 1001 2019-11-25T09:39:19.695 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.629+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:19.724 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.658+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:19.830 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.765+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x5592ebdd97f0 s->prefetch_data=0 2019-11-25T09:39:19.830 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.765+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.779+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2019-11-25T09:39:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.779+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-11-25T09:39:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.779+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.779+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.779+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.779+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2019-11-25T09:39:19.845 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.779+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2019-11-25T09:39:19.867 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:19.802+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617672 cookie 94089510117984 notifier 4484 bl.length()=193 2019-11-25T09:39:20.082 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.017+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4 from cache 2019-11-25T09:39:20.082 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.017+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=250 2019-11-25T09:39:20.091 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.025+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617669 cookie 94089510119616 notifier 4484 bl.length()=250 2019-11-25T09:39:20.350 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.283+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x5592ebdd97f0 s->prefetch_data=0 2019-11-25T09:39:20.350 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.283+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2019-11-25T09:39:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.292+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2019-11-25T09:39:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.292+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-25T09:39:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.292+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.292+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.292+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.292+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:20.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.299+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-25T09:39:20.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.299+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2019-11-25T09:39:20.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.299+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-25T09:39:20.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.299+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5 state=0x5592ebdd1700 s->prefetch_data=0 2019-11-25T09:39:20.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.299+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5 : miss 2019-11-25T09:39:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.317+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5 info.flags=0x16 2019-11-25T09:39:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.317+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5 to cache LRU end 2019-11-25T09:39:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.317+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.317+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.317+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:20.385 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.317+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:20.385 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.317+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:20.385 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.317+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:20.385 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.317+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:20.399 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.333+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-25T09:39:20.399 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.333+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5 info.flags=0x13 2019-11-25T09:39:20.399 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.333+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5 to cache LRU end 2019-11-25T09:39:20.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.333+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:20.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.333+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:20.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.333+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5 2019-11-25T09:39:20.425 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.359+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5]) start [] num_entries 1100 2019-11-25T09:39:20.501 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.435+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-11-25T09:39:20.501 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.435+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-multipart-simple.1:foo state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.447+0000 7f4ec5257ec0 10 manifest: total_size = 18874368 2019-11-25T09:39:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.447+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.71 2019-11-25T09:39:20.514 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.447+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-multipart-simple.1:foo state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:20.514 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.447+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:20.514 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.447+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5 2019-11-25T09:39:20.650 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:20.651 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:20.651 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:20.651 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:20.651 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:20.651 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:20.651 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:20.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:20.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:20.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:20.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:20.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2019-11-25T09:39:20.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2019-11-25T09:39:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=14675968 stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2019-11-25T09:39:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=18866176 part_ofs=10485760 rule->part_size=5242880 2019-11-25T09:39:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2019-11-25T09:39:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2019-11-25T09:39:20.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=19918848 part_ofs=15728640 rule->part_size=3145728 2019-11-25T09:39:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2019-11-25T09:39:20.654 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.584+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.71 2019-11-25T09:39:20.724 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.658+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-simple.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5]) start _multipart_[] num_entries 1001 2019-11-25T09:39:20.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.658+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:20.794 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.727+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:20.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.819+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x5592ebdd97f0 s->prefetch_data=0 2019-11-25T09:39:20.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.819+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:20.902 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.836+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2019-11-25T09:39:20.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.836+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-11-25T09:39:20.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.836+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:20.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.836+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:20.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.836+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:20.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.836+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2019-11-25T09:39:20.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.836+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2019-11-25T09:39:20.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:20.857+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617673 cookie 94089510122560 notifier 4484 bl.length()=183 2019-11-25T09:39:21.481 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.414+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5 from cache 2019-11-25T09:39:21.481 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.414+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=240 2019-11-25T09:39:21.496 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.429+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617666 cookie 94089510124128 notifier 4484 bl.length()=240 2019-11-25T09:39:21.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.860+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x5592ebdd8650 s->prefetch_data=0 2019-11-25T09:39:21.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.860+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2019-11-25T09:39:21.950 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.883+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2019-11-25T09:39:21.950 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.883+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-25T09:39:21.950 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.883+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:21.950 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.883+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:21.950 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.883+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:21.950 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.883+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.893+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=227 2019-11-25T09:39:21.959 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.893+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2019-11-25T09:39:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.893+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-25T09:39:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.893+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 state=0x5592ebdd1700 s->prefetch_data=0 2019-11-25T09:39:21.960 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.893+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 : miss 2019-11-25T09:39:21.982 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.915+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 info.flags=0x16 2019-11-25T09:39:21.982 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.915+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 to cache LRU end 2019-11-25T09:39:21.982 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.915+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:21.982 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.915+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:21.982 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.915+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:21.983 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.915+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:21.983 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.915+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:21.983 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.915+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:21.983 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.915+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:21.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.932+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=319 2019-11-25T09:39:21.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.932+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 info.flags=0x13 2019-11-25T09:39:21.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.932+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 to cache LRU end 2019-11-25T09:39:21.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.932+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:21.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.932+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:21.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.932+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:22.026 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:21.959+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7]) start [] num_entries 1100 2019-11-25T09:39:22.093 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-25T09:39:22.093 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-25T09:39:22.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-25T09:39:22.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-25T09:39:22.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-25T09:39:22.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-25T09:39:22.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-25T09:39:22.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-25T09:39:22.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-25T09:39:22.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-25T09:39:22.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-25T09:39:22.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-25T09:39:22.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.026+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:22.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.041+0000 7f4ec5257ec0 10 manifest: total_size = 5242880 2019-11-25T09:39:22.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.041+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.108 2019-11-25T09:39:22.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.041+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:22.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.041+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:22.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.041+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:22.280 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.213+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:22.280 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.213+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-11-25T09:39:22.280 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.213+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:22.280 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.213+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-25T09:39:22.281 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.213+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.108 2019-11-25T09:39:22.357 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.290+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:22.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.299+0000 7f4ec5257ec0 10 manifest: total_size = 5242880 2019-11-25T09:39:22.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.299+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.109 2019-11-25T09:39:22.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.299+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:22.367 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.299+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:22.367 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.299+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:22.517 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.450+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:22.517 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.450+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-11-25T09:39:22.517 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.450+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:22.517 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.450+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-25T09:39:22.517 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.450+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.109 2019-11-25T09:39:22.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.512+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:22.587 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.520+0000 7f4ec5257ec0 10 manifest: total_size = 5242880 2019-11-25T09:39:22.587 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.520+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _d5vGHTAYf6DRXxs9ADA_m1U47Ht0Bqj 2019-11-25T09:39:22.587 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.520+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:22.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.520+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:22.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.520+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:22.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.633+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:22.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.634+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-11-25T09:39:22.701 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.634+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:22.701 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.634+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-25T09:39:22.701 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.634+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _d5vGHTAYf6DRXxs9ADA_m1U47Ht0Bqj 2019-11-25T09:39:22.772 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.705+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:22.782 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.715+0000 7f4ec5257ec0 10 manifest: total_size = 5242880 2019-11-25T09:39:22.782 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.715+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _ah3QC4iJUxPEhV_Ho_9DlMPDl14esiC 2019-11-25T09:39:22.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.715+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:22.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.715+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:22.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.715+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:22.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.870+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:22.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.870+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-25T09:39:22.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.870+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _ah3QC4iJUxPEhV_Ho_9DlMPDl14esiC 2019-11-25T09:39:22.978 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.912+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:22.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.922+0000 7f4ec5257ec0 10 manifest: total_size = 5242880 2019-11-25T09:39:22.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.922+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.112 2019-11-25T09:39:22.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.922+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:22.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.922+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:22.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:22.922+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:23.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.117+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:23.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.117+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-11-25T09:39:23.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.117+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:23.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.117+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-25T09:39:23.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.117+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.112 2019-11-25T09:39:23.314 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.248+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:23.326 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.261+0000 7f4ec5257ec0 10 manifest: total_size = 5242880 2019-11-25T09:39:23.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.261+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _DoWKPEtQJlcyuYFKgiVS9MSvI9tgGWa 2019-11-25T09:39:23.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.261+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:23.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.261+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:23.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.261+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:23.470 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.405+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:23.471 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.405+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-11-25T09:39:23.471 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.405+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:23.471 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.405+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-25T09:39:23.471 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.405+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _DoWKPEtQJlcyuYFKgiVS9MSvI9tgGWa 2019-11-25T09:39:23.570 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.499+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.510+0000 7f4ec5257ec0 10 manifest: total_size = 5242880 2019-11-25T09:39:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.510+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.114 2019-11-25T09:39:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.510+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.510+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.510+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:23.707 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.641+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:23.708 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.641+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-11-25T09:39:23.708 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.641+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:23.708 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.641+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-25T09:39:23.708 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.641+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.114 2019-11-25T09:39:23.782 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.716+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:23.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.725+0000 7f4ec5257ec0 10 manifest: total_size = 5242880 2019-11-25T09:39:23.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.725+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _bFmDVYuK71ndmDV5dZ0yc2qhCSTh_sA 2019-11-25T09:39:23.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.725+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:23.792 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.725+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:23.792 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.725+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:23.960 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.894+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:23.960 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.894+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-11-25T09:39:23.960 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:23.894+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _bFmDVYuK71ndmDV5dZ0yc2qhCSTh_sA 2019-11-25T09:39:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.056+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:24.137 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.071+0000 7f4ec5257ec0 10 manifest: total_size = 324167 2019-11-25T09:39:24.137 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.071+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.116 2019-11-25T09:39:24.137 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.071+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:24.137 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.071+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:24.137 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.071+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:24.349 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.284+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:24.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.297+0000 7f4ec5257ec0 10 manifest: total_size = 324167 2019-11-25T09:39:24.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.297+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _k-m0zctAoLgcQpdrywRNCHmEXjooYZ4 2019-11-25T09:39:24.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.297+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:24.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.297+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:24.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.297+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:24.571 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.499+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:24.571 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.499+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=324167 stripe_ofs=324167 part_ofs=0 rule->part_size=0 2019-11-25T09:39:24.571 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.499+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _k-m0zctAoLgcQpdrywRNCHmEXjooYZ4 2019-11-25T09:39:24.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.548+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.556+0000 7f4ec5257ec0 10 manifest: total_size = 324167 2019-11-25T09:39:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.556+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _Jlww8F6eNpgNVU4-U7uqxyQlZtgQGUI 2019-11-25T09:39:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.556+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.556+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:24.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.556+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:24.799 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.733+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:24.799 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.733+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=324167 stripe_ofs=324167 part_ofs=0 rule->part_size=0 2019-11-25T09:39:24.799 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.733+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _Jlww8F6eNpgNVU4-U7uqxyQlZtgQGUI 2019-11-25T09:39:24.901 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.836+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:24.912 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.846+0000 7f4ec5257ec0 10 manifest: total_size = 324167 2019-11-25T09:39:24.912 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.846+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _wFQmJXwTbMIChGaFXngQDc4uKLvFWPA 2019-11-25T09:39:24.912 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.846+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:24.912 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.846+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:24.913 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:24.846+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 2019-11-25T09:39:25.107 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.040+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-copy.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7]) start _multipart_[] num_entries 1001 2019-11-25T09:39:25.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.040+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:25.257 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.191+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:25.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.304+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x5592ebdd1700 s->prefetch_data=0 2019-11-25T09:39:25.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.304+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:25.383 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.317+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2019-11-25T09:39:25.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.317+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-11-25T09:39:25.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.317+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:25.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.317+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:25.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.317+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:25.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.318+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2019-11-25T09:39:25.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.318+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-11-25T09:39:25.392 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.326+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617674 cookie 94089510117984 notifier 4484 bl.length()=189 2019-11-25T09:39:25.768 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.702+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7 from cache 2019-11-25T09:39:25.768 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.702+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=246 2019-11-25T09:39:25.789 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:25.723+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617670 cookie 94089510119616 notifier 4484 bl.length()=246 2019-11-25T09:39:26.516 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.450+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x5592ebdd70c0 s->prefetch_data=0 2019-11-25T09:39:26.516 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.450+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2019-11-25T09:39:26.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.469+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2019-11-25T09:39:26.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.469+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-25T09:39:26.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.469+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:26.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.469+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:26.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.469+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:26.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.469+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:26.554 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.488+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=237 2019-11-25T09:39:26.554 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.488+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2019-11-25T09:39:26.554 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.488+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-25T09:39:26.555 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.488+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 state=0x5592ebdd8650 s->prefetch_data=0 2019-11-25T09:39:26.555 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.488+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 : miss 2019-11-25T09:39:26.619 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.553+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 info.flags=0x16 2019-11-25T09:39:26.620 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.553+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 to cache LRU end 2019-11-25T09:39:26.620 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.553+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:26.620 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.553+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:26.620 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.553+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:26.620 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.553+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:26.621 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.553+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:26.621 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.553+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:26.621 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.553+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:26.656 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.590+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=329 2019-11-25T09:39:26.656 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.590+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 info.flags=0x13 2019-11-25T09:39:26.656 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.590+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 to cache LRU end 2019-11-25T09:39:26.657 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.590+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:26.657 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.590+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:26.657 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.590+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:26.690 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.624+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9]) start [] num_entries 1100 2019-11-25T09:39:26.774 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-25T09:39:26.775 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-11-25T09:39:26.775 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-11-25T09:39:26.775 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-11-25T09:39:26.775 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-25T09:39:26.775 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-11-25T09:39:26.775 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-11-25T09:39:26.775 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-11-25T09:39:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-25T09:39:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-11-25T09:39:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-11-25T09:39:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-11-25T09:39:26.776 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.708+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.728+0000 7f4ec5257ec0 10 manifest: total_size = 11534336 2019-11-25T09:39:26.794 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.728+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.224 2019-11-25T09:39:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.728+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:26.795 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.728+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:26.809 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.728+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:26.990 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:26.990 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:26.991 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:26.991 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:26.991 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:26.991 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:26.991 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:26.991 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:26.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:26.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:26.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:26.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:26.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-25T09:39:26.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:26.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-25T09:39:26.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.924+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.224 2019-11-25T09:39:27.061 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:26.995+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:27.069 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.003+0000 7f4ec5257ec0 10 manifest: total_size = 11534336 2019-11-25T09:39:27.069 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.003+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.225 2019-11-25T09:39:27.070 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.003+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:27.070 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.003+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:27.070 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.003+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:27.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:27.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:27.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:27.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:27.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:27.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-25T09:39:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.232+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-25T09:39:27.301 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.233+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.225 2019-11-25T09:39:27.348 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.282+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:27.357 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.291+0000 7f4ec5257ec0 10 manifest: total_size = 11534336 2019-11-25T09:39:27.357 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.291+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _ecaxEbyMn8gbNKst_yVvr4Q0aChGie7 2019-11-25T09:39:27.357 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.291+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:27.357 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.291+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:27.357 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.291+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:27.512 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.446+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:27.513 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.446+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-11-25T09:39:27.513 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.446+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:27.513 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.446+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-11-25T09:39:27.513 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.446+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:27.513 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.446+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-25T09:39:27.513 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.446+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _ecaxEbyMn8gbNKst_yVvr4Q0aChGie7 2019-11-25T09:39:27.660 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.594+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:27.676 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.610+0000 7f4ec5257ec0 10 manifest: total_size = 11534336 2019-11-25T09:39:27.676 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.610+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _bx7C3PtD7kBHShvR2NoHoAuFrvKIv1O 2019-11-25T09:39:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.610+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.610+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:27.677 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.610+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:27.846 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.780+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:27.846 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.780+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-11-25T09:39:27.846 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.780+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:27.847 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.780+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-25T09:39:27.847 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.780+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _bx7C3PtD7kBHShvR2NoHoAuFrvKIv1O 2019-11-25T09:39:27.905 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.839+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:27.914 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.848+0000 7f4ec5257ec0 10 manifest: total_size = 11534336 2019-11-25T09:39:27.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.848+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.233 2019-11-25T09:39:27.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.848+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:27.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.848+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:27.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:27.848+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:28.099 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:28.100 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:28.100 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:28.100 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:28.100 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:28.100 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:28.100 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-25T09:39:28.101 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:28.102 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-25T09:39:28.102 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.032+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.233 2019-11-25T09:39:28.151 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.085+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:28.160 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.094+0000 7f4ec5257ec0 10 manifest: total_size = 11534336 2019-11-25T09:39:28.160 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.094+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _9Lrh_q6zjtHUFSq6Sw1PMmKI1f4QvbL 2019-11-25T09:39:28.161 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.094+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:28.161 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.094+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:28.161 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.094+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:28.338 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.272+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:28.338 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.272+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-11-25T09:39:28.338 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.272+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:28.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.272+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-11-25T09:39:28.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.272+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:28.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.272+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-25T09:39:28.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.272+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _9Lrh_q6zjtHUFSq6Sw1PMmKI1f4QvbL 2019-11-25T09:39:28.408 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.342+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:28.420 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.354+0000 7f4ec5257ec0 10 manifest: total_size = 11534336 2019-11-25T09:39:28.420 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.354+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.235 2019-11-25T09:39:28.421 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.354+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:28.421 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.354+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:28.421 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.354+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.526+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.526+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.526+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-25T09:39:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-25T09:39:28.597 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.527+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.235 2019-11-25T09:39:28.657 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.591+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:28.668 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.600+0000 7f4ec5257ec0 10 manifest: total_size = 11534336 2019-11-25T09:39:28.669 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.600+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _gyCatk4BnKj_R_bBufA1r3fsQzIt_dn 2019-11-25T09:39:28.669 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.600+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:28.669 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.600+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:28.669 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.600+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:28.774 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.707+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:28.774 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.707+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-11-25T09:39:28.774 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.707+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:28.774 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.707+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-11-25T09:39:28.774 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.707+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _gyCatk4BnKj_R_bBufA1r3fsQzIt_dn 2019-11-25T09:39:28.825 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.758+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:28.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.766+0000 7f4ec5257ec0 10 manifest: total_size = 1140 2019-11-25T09:39:28.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.766+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.242 2019-11-25T09:39:28.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.766+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:28.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.766+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:28.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.766+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:28.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.896+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-25T09:39:28.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.896+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=515 2019-11-25T09:39:28.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.896+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-11-25T09:39:28.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.896+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-25T09:39:28.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.896+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4190723 part_ofs=515 rule->part_size=515 2019-11-25T09:39:28.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.896+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=110 2019-11-25T09:39:28.964 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.896+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=110 rules.size()=2 2019-11-25T09:39:28.964 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.896+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4191238 part_ofs=1030 rule->part_size=110 2019-11-25T09:39:28.964 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.896+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=1140 rule->part_size=110 2019-11-25T09:39:28.964 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.896+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.242 2019-11-25T09:39:29.008 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.942+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:29.023 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.957+0000 7f4ec5257ec0 10 manifest: total_size = 1140 2019-11-25T09:39:29.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.957+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _Do0HoFVsb4c7w20UVOJSdYfnE-RAtBP 2019-11-25T09:39:29.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.957+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:29.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.957+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:29.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:28.957+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.115+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.115+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=0 rule->part_size=0 2019-11-25T09:39:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.115+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _Do0HoFVsb4c7w20UVOJSdYfnE-RAtBP 2019-11-25T09:39:29.291 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.225+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:29.306 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.240+0000 7f4ec5257ec0 10 manifest: total_size = 1140 2019-11-25T09:39:29.307 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.240+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to _tzTZTgsZHGfuUKhf9c9yMYvQ7q2G5sl 2019-11-25T09:39:29.307 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.240+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:29.307 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.240+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:29.307 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.240+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:29.485 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.419+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:29.485 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.419+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=0 rule->part_size=0 2019-11-25T09:39:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.419+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _tzTZTgsZHGfuUKhf9c9yMYvQ7q2G5sl 2019-11-25T09:39:29.624 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.557+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:29.643 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.576+0000 7f4ec5257ec0 10 manifest: total_size = 1140 2019-11-25T09:39:29.643 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.576+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.245 2019-11-25T09:39:29.643 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.576+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:29.643 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.576+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:29.643 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.576+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 2019-11-25T09:39:29.808 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.742+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-25T09:39:29.808 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.742+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=515 2019-11-25T09:39:29.809 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.742+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-11-25T09:39:29.809 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.742+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-11-25T09:39:29.809 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.742+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4190723 part_ofs=515 rule->part_size=515 2019-11-25T09:39:29.809 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.742+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=110 2019-11-25T09:39:29.809 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.742+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=110 rules.size()=2 2019-11-25T09:39:29.809 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.742+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4191238 part_ofs=1030 rule->part_size=110 2019-11-25T09:39:29.809 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.742+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=1140 stripe_ofs=1140 part_ofs=1140 rule->part_size=110 2019-11-25T09:39:29.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.742+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.245 2019-11-25T09:39:29.958 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.892+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9]) start _multipart_[] num_entries 1001 2019-11-25T09:39:29.958 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.892+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:29.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:29.926+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.061+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x5592ebdd8650 s->prefetch_data=0 2019-11-25T09:39:30.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.061+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:30.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.076+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2019-11-25T09:39:30.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.076+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-11-25T09:39:30.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.076+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:30.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.076+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:30.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.076+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:30.143 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.076+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2019-11-25T09:39:30.143 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.076+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2019-11-25T09:39:30.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.090+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617671 cookie 94089510119616 notifier 4484 bl.length()=199 2019-11-25T09:39:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.590+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9 from cache 2019-11-25T09:39:30.657 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.590+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=256 2019-11-25T09:39:30.672 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:30.606+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617675 cookie 94089510122560 notifier 4484 bl.length()=256 2019-11-25T09:39:31.088 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.020+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x5592ebdd70c0 s->prefetch_data=0 2019-11-25T09:39:31.088 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.020+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2019-11-25T09:39:31.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.041+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2019-11-25T09:39:31.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.041+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-25T09:39:31.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.041+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:31.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.041+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:31.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.041+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:31.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.041+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:31.126 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.058+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=232 2019-11-25T09:39:31.126 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.058+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2019-11-25T09:39:31.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.058+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-25T09:39:31.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.058+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 state=0x5592ebdd9f60 s->prefetch_data=0 2019-11-25T09:39:31.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.058+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 : miss 2019-11-25T09:39:31.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.074+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 info.flags=0x16 2019-11-25T09:39:31.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.074+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 to cache LRU end 2019-11-25T09:39:31.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.074+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:31.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.074+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:31.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.074+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:31.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.074+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:31.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.074+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:31.143 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.074+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:31.143 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.074+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:31.170 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.103+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=324 2019-11-25T09:39:31.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.103+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 info.flags=0x13 2019-11-25T09:39:31.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.103+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 to cache LRU end 2019-11-25T09:39:31.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.103+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:31.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.103+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:31.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.103+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 2019-11-25T09:39:31.211 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.144+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8]) start [] num_entries 1100 2019-11-25T09:39:31.262 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.195+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-25T09:39:31.263 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.195+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-25T09:39:31.263 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.195+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-25T09:39:31.263 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.195+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5592ebddcf28 s->prefetch_data=0 2019-11-25T09:39:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.217+0000 7f4ec5257ec0 10 manifest: total_size = 11534336 2019-11-25T09:39:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.217+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.196 2019-11-25T09:39:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.217+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5592ebddcf28 s->prefetch_data=0 2019-11-25T09:39:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.217+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebddcf28 2019-11-25T09:39:31.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.217+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 2019-11-25T09:39:31.467 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:31.467 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:31.467 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:31.467 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:31.467 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:31.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:31.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:31.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:31.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:31.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:31.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:31.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:31.469 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-25T09:39:31.469 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:31.469 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-25T09:39:31.469 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.399+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.196 2019-11-25T09:39:31.531 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.464+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5592ebddcf28 s->prefetch_data=0 2019-11-25T09:39:31.542 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.474+0000 7f4ec5257ec0 10 manifest: total_size = 11534336 2019-11-25T09:39:31.542 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.474+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.203 2019-11-25T09:39:31.542 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.474+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5592ebddcf28 s->prefetch_data=0 2019-11-25T09:39:31.542 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.474+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebddcf28 2019-11-25T09:39:31.543 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.475+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 2019-11-25T09:39:31.599 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.531+0000 7f4e82fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T09:39:31.728 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:31.728 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:31.728 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:31.729 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:31.729 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-11-25T09:39:31.729 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:31.729 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:31.729 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:31.729 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:31.730 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-11-25T09:39:31.730 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-11-25T09:39:31.730 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:31.730 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-11-25T09:39:31.730 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-11-25T09:39:31.730 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-11-25T09:39:31.730 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.661+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.203 2019-11-25T09:39:31.787 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.720+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5592ebddcf28 s->prefetch_data=0 2019-11-25T09:39:31.796 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.729+0000 7f4ec5257ec0 10 manifest: total_size = 16378 2019-11-25T09:39:31.796 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.729+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.210 2019-11-25T09:39:31.796 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.729+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5592ebddcf28 s->prefetch_data=0 2019-11-25T09:39:31.797 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.729+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebddcf28 2019-11-25T09:39:31.797 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.729+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 2019-11-25T09:39:31.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.873+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2019-11-25T09:39:31.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.873+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7673 2019-11-25T09:39:31.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.873+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=7673 stripe_ofs=7673 part_ofs=7673 rule->part_size=7670 2019-11-25T09:39:31.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.873+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2019-11-25T09:39:31.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.873+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4197881 part_ofs=7673 rule->part_size=7670 2019-11-25T09:39:31.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.873+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=1035 2019-11-25T09:39:31.942 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.873+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2019-11-25T09:39:31.942 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.873+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): stripe_ofs=4205551 part_ofs=15343 rule->part_size=1035 2019-11-25T09:39:31.942 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.873+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=16378 stripe_ofs=16378 part_ofs=16378 rule->part_size=1035 2019-11-25T09:39:31.942 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.873+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.210 2019-11-25T09:39:32.013 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.946+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8]) start _multipart_[] num_entries 1001 2019-11-25T09:39:32.013 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.946+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:32.036 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:31.968+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:32.137 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.070+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x5592ebdd9f60 s->prefetch_data=0 2019-11-25T09:39:32.138 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.070+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:32.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.086+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2019-11-25T09:39:32.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.086+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-11-25T09:39:32.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.086+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:32.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.086+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:32.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.086+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:32.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.086+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2019-11-25T09:39:32.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.086+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2019-11-25T09:39:32.172 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.104+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617667 cookie 94089510124128 notifier 4484 bl.length()=194 2019-11-25T09:39:32.635 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.567+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8 from cache 2019-11-25T09:39:32.635 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.567+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=251 2019-11-25T09:39:32.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.585+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617676 cookie 94089510122560 notifier 4484 bl.length()=251 2019-11-25T09:39:33.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.947+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x5592ebdd9f60 s->prefetch_data=0 2019-11-25T09:39:33.015 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.947+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2019-11-25T09:39:33.023 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.956+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2019-11-25T09:39:33.023 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.956+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-25T09:39:33.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.956+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:33.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.956+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:33.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.956+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:33.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.956+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:33.033 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.966+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=222 2019-11-25T09:39:33.034 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.966+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2019-11-25T09:39:33.034 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.966+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-25T09:39:33.034 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.966+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 state=0x5592ebdd70c0 s->prefetch_data=0 2019-11-25T09:39:33.034 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.966+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 : miss 2019-11-25T09:39:33.044 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.977+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 info.flags=0x16 2019-11-25T09:39:33.044 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.977+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 to cache LRU end 2019-11-25T09:39:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.977+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.977+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.977+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.977+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.977+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.977+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.977+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:33.057 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.990+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=314 2019-11-25T09:39:33.057 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.990+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 info.flags=0x13 2019-11-25T09:39:33.058 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.990+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 to cache LRU end 2019-11-25T09:39:33.058 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.990+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:33.058 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.990+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:33.058 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:32.990+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 2019-11-25T09:39:33.080 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.012+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6]) start [] num_entries 1100 2019-11-25T09:39:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.046+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-11-25T09:39:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.046+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-11-25T09:39:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.046+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-11-25T09:39:33.114 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.047+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:33.126 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.059+0000 7f4ec5257ec0 10 manifest: total_size = 10485760 2019-11-25T09:39:33.126 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.059+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.84 2019-11-25T09:39:33.126 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.059+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.059+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:33.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.059+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 2019-11-25T09:39:33.262 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.194+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:33.262 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.194+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-11-25T09:39:33.262 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.194+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:33.263 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.194+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-11-25T09:39:33.263 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.194+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:33.263 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.194+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-25T09:39:33.263 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.194+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.84 2019-11-25T09:39:33.330 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.262+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:33.342 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.275+0000 7f4ec5257ec0 10 manifest: total_size = 10485760 2019-11-25T09:39:33.342 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.275+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.85 2019-11-25T09:39:33.343 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.275+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:33.343 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.275+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:33.343 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.275+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 2019-11-25T09:39:33.538 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.471+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:33.538 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.471+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-11-25T09:39:33.538 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.471+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:33.539 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.471+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-11-25T09:39:33.539 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.471+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-11-25T09:39:33.539 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.471+0000 7f4ec5257ec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-11-25T09:39:33.539 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.471+0000 7f4ec5257ec0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.85 2019-11-25T09:39:33.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.538+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:33.629 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.562+0000 7f4ec5257ec0 10 manifest: total_size = 44258 2019-11-25T09:39:33.630 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.562+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.86 2019-11-25T09:39:33.630 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.562+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:33.631 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.562+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:33.631 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.562+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 2019-11-25T09:39:33.766 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.700+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6]) start _multipart_[] num_entries 1001 2019-11-25T09:39:33.767 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.700+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:33.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.807+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:33.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.906+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x5592ebdd9f60 s->prefetch_data=0 2019-11-25T09:39:33.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.906+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:33.987 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.919+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2019-11-25T09:39:33.987 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.919+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-11-25T09:39:33.987 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.919+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:33.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.919+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:33.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.919+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:33.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.920+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2019-11-25T09:39:33.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.920+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2019-11-25T09:39:33.996 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:33.929+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617677 cookie 94089510117984 notifier 4484 bl.length()=184 2019-11-25T09:39:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.523+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6 from cache 2019-11-25T09:39:34.590 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.523+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=241 2019-11-25T09:39:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.537+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617668 cookie 94089510115072 notifier 4484 bl.length()=241 2019-11-25T09:39:35.002 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.936+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x5592ebdd9f60 s->prefetch_data=0 2019-11-25T09:39:35.003 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.936+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2019-11-25T09:39:35.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.957+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2019-11-25T09:39:35.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.957+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-25T09:39:35.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.957+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:35.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.957+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:35.024 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.957+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:35.025 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.957+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:35.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.979+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-25T09:39:35.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.979+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2019-11-25T09:39:35.046 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.979+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-25T09:39:35.046 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.979+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 state=0x5592ebdd70c0 s->prefetch_data=0 2019-11-25T09:39:35.046 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.979+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 : miss 2019-11-25T09:39:35.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.999+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 info.flags=0x16 2019-11-25T09:39:35.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.999+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 to cache LRU end 2019-11-25T09:39:35.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.999+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:35.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.999+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.999+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.999+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.999+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.999+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:35.067 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:34.999+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.026+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-25T09:39:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.026+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 info.flags=0x13 2019-11-25T09:39:35.093 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.026+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 to cache LRU end 2019-11-25T09:39:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.026+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.026+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:35.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.026+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 2019-11-25T09:39:35.136 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.070+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10]) start [] num_entries 1100 2019-11-25T09:39:35.248 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.182+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-25T09:39:35.248 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.182+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-25T09:39:35.249 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.182+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-25T09:39:35.249 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.182+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-25T09:39:35.249 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.182+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.1:__ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:35.272 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.206+0000 7f4ec5257ec0 10 manifest: total_size = 4134 2019-11-25T09:39:35.272 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.206+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.305 2019-11-25T09:39:35.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.206+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.1:__ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:35.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.206+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:35.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.206+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 2019-11-25T09:39:35.459 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.392+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:35.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.409+0000 7f4ec5257ec0 10 manifest: total_size = 1035 2019-11-25T09:39:35.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.409+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.307 2019-11-25T09:39:35.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.410+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:35.477 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.410+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:35.477 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.410+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 2019-11-25T09:39:35.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.680+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.1:___ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.721+0000 7f4ec5257ec0 10 manifest: total_size = 1035 2019-11-25T09:39:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.721+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.306 2019-11-25T09:39:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.721+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.1:___ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.721+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:35.721+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 2019-11-25T09:39:36.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.146+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.1:obj state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:36.223 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.156+0000 7f4ec5257ec0 10 manifest: total_size = 4134 2019-11-25T09:39:36.223 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.156+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.304 2019-11-25T09:39:36.223 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.156+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.1:obj state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:36.223 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.156+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:36.223 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.156+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 2019-11-25T09:39:36.448 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.379+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10]) start _multipart_[] num_entries 1001 2019-11-25T09:39:36.448 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.379+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:36.546 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.479+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:36.672 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.606+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x5592ebdd9f60 s->prefetch_data=0 2019-11-25T09:39:36.673 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.606+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:36.703 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.636+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2019-11-25T09:39:36.703 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.636+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-11-25T09:39:36.703 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.636+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:36.703 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.636+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:36.703 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.636+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:36.704 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.636+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2019-11-25T09:39:36.704 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.636+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-25T09:39:36.715 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:36.648+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617669 cookie 94089510115072 notifier 4484 bl.length()=181 2019-11-25T09:39:37.539 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.473+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.10 from cache 2019-11-25T09:39:37.540 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.473+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2019-11-25T09:39:37.553 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.487+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617666 cookie 94089510127328 notifier 4484 bl.length()=239 2019-11-25T09:39:37.779 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.712+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x5592ebd435e0 s->prefetch_data=0 2019-11-25T09:39:37.779 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.712+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2019-11-25T09:39:37.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.724+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2019-11-25T09:39:37.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.724+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-25T09:39:37.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.724+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:37.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.724+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:37.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.724+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:37.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.724+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:37.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.743+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-25T09:39:37.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.743+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2019-11-25T09:39:37.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.743+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-25T09:39:37.811 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.743+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 state=0x5592ebdd9f60 s->prefetch_data=0 2019-11-25T09:39:37.811 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.743+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 : miss 2019-11-25T09:39:37.837 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.770+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 info.flags=0x16 2019-11-25T09:39:37.837 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.770+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 to cache LRU end 2019-11-25T09:39:37.838 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.770+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:37.838 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.770+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:37.838 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.770+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:37.838 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.770+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:37.838 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.770+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:37.838 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.770+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:37.839 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.770+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:37.863 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.797+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-25T09:39:37.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.797+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 info.flags=0x13 2019-11-25T09:39:37.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.797+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 to cache LRU end 2019-11-25T09:39:37.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.797+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:37.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.797+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:37.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.797+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 2019-11-25T09:39:37.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.820+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11]) start [] num_entries 1100 2019-11-25T09:39:37.923 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.856+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-25T09:39:37.923 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.856+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-25T09:39:37.923 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.856+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-25T09:39:37.923 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.856+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-25T09:39:37.923 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.856+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:37.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.870+0000 7f4ec5257ec0 10 manifest: total_size = 527 2019-11-25T09:39:37.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.870+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.312 2019-11-25T09:39:37.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.870+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:37.938 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.870+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:37.938 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:37.870+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 2019-11-25T09:39:38.135 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.068+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:38.181 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.114+0000 7f4ec5257ec0 10 manifest: total_size = 24595 2019-11-25T09:39:38.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.114+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.314 2019-11-25T09:39:38.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.114+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:38.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.114+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:38.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.114+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 2019-11-25T09:39:38.382 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.316+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:38.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.329+0000 7f4ec5257ec0 10 manifest: total_size = 527 2019-11-25T09:39:38.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.329+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.313 2019-11-25T09:39:38.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.329+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:38.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.329+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:38.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.329+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 2019-11-25T09:39:38.655 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.588+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:38.664 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.597+0000 7f4ec5257ec0 10 manifest: total_size = 2078 2019-11-25T09:39:38.664 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.597+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.311 2019-11-25T09:39:38.664 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.597+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5592ebdd8e38 s->prefetch_data=0 2019-11-25T09:39:38.664 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.597+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebdd8e38 2019-11-25T09:39:38.664 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.597+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 2019-11-25T09:39:38.847 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.780+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.2[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11]) start _multipart_[] num_entries 1001 2019-11-25T09:39:38.847 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.780+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:38.954 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.886+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:39.051 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.984+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x5592ebdd9f60 s->prefetch_data=0 2019-11-25T09:39:39.051 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:38.984+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.012+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2019-11-25T09:39:39.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.012+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-11-25T09:39:39.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.012+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:39.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.012+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:39.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.012+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:39.096 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.012+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2019-11-25T09:39:39.096 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.012+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-25T09:39:39.101 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.034+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617670 cookie 94089510115072 notifier 4484 bl.length()=181 2019-11-25T09:39:39.443 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.376+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.11 from cache 2019-11-25T09:39:39.443 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.376+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2019-11-25T09:39:39.454 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.387+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617667 cookie 94089510127328 notifier 4484 bl.length()=239 2019-11-25T09:39:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.781+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x5592ebdddfc0 s->prefetch_data=0 2019-11-25T09:39:39.848 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.781+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2019-11-25T09:39:39.863 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.796+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2019-11-25T09:39:39.863 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.796+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-25T09:39:39.863 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.796+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:39.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.796+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:39.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.796+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2019-11-25T09:39:39.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.796+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:39.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.809+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=221 2019-11-25T09:39:39.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.809+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2019-11-25T09:39:39.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.809+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-25T09:39:39.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.809+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281c60 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 state=0x5592ebd435e0 s->prefetch_data=0 2019-11-25T09:39:39.877 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.809+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 : miss 2019-11-25T09:39:39.890 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.823+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 info.flags=0x16 2019-11-25T09:39:39.890 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.823+0000 7f4ec5257ec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 to cache LRU end 2019-11-25T09:39:39.890 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.823+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:39.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.823+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:39.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.823+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:39.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.823+0000 7f4ec5257ec0 20 Read xattr: user.rgw.acl 2019-11-25T09:39:39.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.823+0000 7f4ec5257ec0 20 Read xattr: user.rgw.idtag 2019-11-25T09:39:39.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.823+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 : type miss (requested=0x13, cached=0x16) 2019-11-25T09:39:39.892 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.823+0000 7f4ec5257ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:39.906 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.838+0000 7f4ec5257ec0 20 rados_obj.operate() r=0 bl.length=313 2019-11-25T09:39:39.906 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.838+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 info.flags=0x13 2019-11-25T09:39:39.906 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.838+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 to cache LRU end 2019-11-25T09:39:39.907 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.838+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:39.907 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.838+0000 7f4ec5257ec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-11-25T09:39:39.907 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.838+0000 7f4ec5257ec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 2019-11-25T09:39:39.936 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.869+0000 7f4ec5257ec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12]) start [] num_entries 1100 2019-11-25T09:39:39.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.918+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-11-25T09:39:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.918+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-11-25T09:39:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.918+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-11-25T09:39:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.918+0000 7f4ec5257ec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-11-25T09:39:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.918+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5592ebd42d78 s->prefetch_data=0 2019-11-25T09:39:39.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.932+0000 7f4ec5257ec0 10 manifest: total_size = 0 2019-11-25T09:39:39.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.932+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.319 2019-11-25T09:39:39.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.932+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5592ebd42d78 s->prefetch_data=0 2019-11-25T09:39:39.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.932+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebd42d78 2019-11-25T09:39:39.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:39.932+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 2019-11-25T09:39:40.151 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.084+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5592ebd42d78 s->prefetch_data=0 2019-11-25T09:39:40.174 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.107+0000 7f4ec5257ec0 10 manifest: total_size = 0 2019-11-25T09:39:40.174 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.107+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.321 2019-11-25T09:39:40.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.107+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5592ebd42d78 s->prefetch_data=0 2019-11-25T09:39:40.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.107+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebd42d78 2019-11-25T09:39:40.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.107+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 2019-11-25T09:39:40.361 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.286+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5592ebd42d78 s->prefetch_data=0 2019-11-25T09:39:40.361 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.294+0000 7f4ec5257ec0 10 manifest: total_size = 0 2019-11-25T09:39:40.362 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.294+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.320 2019-11-25T09:39:40.362 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.294+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5592ebd42d78 s->prefetch_data=0 2019-11-25T09:39:40.362 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.294+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebd42d78 2019-11-25T09:39:40.362 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.294+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 2019-11-25T09:39:40.628 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.561+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5592ebd42d78 s->prefetch_data=0 2019-11-25T09:39:40.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.585+0000 7f4ec5257ec0 10 manifest: total_size = 0 2019-11-25T09:39:40.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.585+0000 7f4ec5257ec0 20 get_obj_state: setting s->obj_tag to b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.318 2019-11-25T09:39:40.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.585+0000 7f4ec5257ec0 20 get_obj_state: rctx=0x7ffc91281c80 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5592ebd42d78 s->prefetch_data=0 2019-11-25T09:39:40.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.585+0000 7f4ec5257ec0 20 prepare_atomic_modification: state is not atomic. state=0x5592ebd42d78 2019-11-25T09:39:40.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.585+0000 7f4ec5257ec0 20 bucket index object: default.rgw.buckets.index:.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 2019-11-25T09:39:40.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.878+0000 7f4ec5257ec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.3[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12]) start _multipart_[] num_entries 1001 2019-11-25T09:39:40.946 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.878+0000 7f4ec5257ec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-11-25T09:39:41.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:40.978+0000 7f4ec5257ec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12])"; objs.size()=0; is_truncated=0 2019-11-25T09:39:41.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.114+0000 7f4ec5257ec0 20 get_system_obj_state: rctx=0x7ffc91281618 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x5592ebdddfc0 s->prefetch_data=0 2019-11-25T09:39:41.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.114+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2019-11-25T09:39:41.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.145+0000 7f4ec5257ec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2019-11-25T09:39:41.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.146+0000 7f4ec5257ec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-11-25T09:39:41.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.146+0000 7f4ec5257ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T09:39:41.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.146+0000 7f4ec5257ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T09:39:41.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.146+0000 7f4ec5257ec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2019-11-25T09:39:41.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.146+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2019-11-25T09:39:41.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.146+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-11-25T09:39:41.228 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.161+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617671 cookie 94089510115072 notifier 4484 bl.length()=181 2019-11-25T09:39:41.742 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.674+0000 7f4ec5257ec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.12 from cache 2019-11-25T09:39:41.743 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.674+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=239 2019-11-25T09:39:41.754 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:41.686+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617668 cookie 94089510127328 notifier 4484 bl.length()=239 2019-11-25T09:39:42.091 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:42.022+0000 7f4ec5257ec0 10 removing key index: FDHTKSXNTKHRSAZDQMFO 2019-11-25T09:39:42.091 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:42.022+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=170 2019-11-25T09:39:42.102 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:42.034+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617672 cookie 94089510119616 notifier 4484 bl.length()=170 2019-11-25T09:39:42.392 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:42.323+0000 7f4ec5257ec0 10 removing email index: ragweed.client.0+test@test.test 2019-11-25T09:39:42.392 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:42.323+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2019-11-25T09:39:42.410 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:42.342+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617678 cookie 94089510117984 notifier 4484 bl.length()=182 2019-11-25T09:39:42.739 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:42.671+0000 7f4ec5257ec0 10 removing user buckets index 2019-11-25T09:39:42.739 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:42.671+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2019-11-25T09:39:42.754 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:42.686+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617672 cookie 94089510124128 notifier 4484 bl.length()=173 2019-11-25T09:39:43.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:43.146+0000 7f4ec5257ec0 10 removing user index: ragweed.client.0 2019-11-25T09:39:43.215 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:43.146+0000 7f4ec5257ec0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2019-11-25T09:39:43.215 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:43.146+0000 7f4ec5257ec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2019-11-25T09:39:43.237 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:43.169+0000 7f4e937fe700 10 RGWWatcher::handle_notify() notify_id 575525617679 cookie 94089510122560 notifier 4484 bl.length()=165 2019-11-25T09:39:43.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:43.820+0000 7f4ec5257ec0 20 remove_watcher() i=0 2019-11-25T09:39:43.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:43.820+0000 7f4ec5257ec0 2 removed watcher, disabling cache 2019-11-25T09:39:43.952 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:43.884+0000 7f4ec5257ec0 20 remove_watcher() i=1 2019-11-25T09:39:44.025 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:43.957+0000 7f4ec5257ec0 20 remove_watcher() i=2 2019-11-25T09:39:44.070 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:44.002+0000 7f4ec5257ec0 20 remove_watcher() i=3 2019-11-25T09:39:44.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:44.059+0000 7f4ec5257ec0 20 remove_watcher() i=4 2019-11-25T09:39:44.169 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:44.101+0000 7f4ec5257ec0 20 remove_watcher() i=5 2019-11-25T09:39:44.224 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:44.157+0000 7f4ec5257ec0 20 remove_watcher() i=6 2019-11-25T09:39:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:44.200+0000 7f4ec5257ec0 20 remove_watcher() i=7 2019-11-25T09:39:44.277 INFO:tasks.ragweed:Removing ragweed... 2019-11-25T09:39:44.277 INFO:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/ragweed 2019-11-25T09:39:44.393 INFO:teuthology.run_tasks:Running task s3tests-java... 2019-11-25T09:39:44.408 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2019-11-25T09:39:44.408 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2019-11-25T09:39:44.409 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2019-11-25T09:39:44.409 INFO:teuthology.orchestra.run.smithi135:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2019-11-25T09:39:44.459 INFO:teuthology.orchestra.run.smithi135.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2019-11-25T09:39:48.644 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2019-11-25T09:39:48.645 INFO:teuthology.orchestra.run.smithi135:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2019-11-25T09:39:51.418 INFO:teuthology.orchestra.run.smithi135.stdout: Gradle will be installed under /opt/gradle 2019-11-25T09:39:51.493 INFO:teuthology.orchestra.run.smithi135.stderr:--2019-11-25 09:39:51-- https://services.gradle.org/distributions/gradle-4.7-bin.zip 2019-11-25T09:39:51.513 INFO:teuthology.orchestra.run.smithi135.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.191.9, 104.18.190.9, 2606:4700::6812:bf09, ... 2019-11-25T09:39:51.521 INFO:teuthology.orchestra.run.smithi135.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.191.9|:443... connected. 2019-11-25T09:39:51.559 INFO:teuthology.orchestra.run.smithi135.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2019-11-25T09:39:51.559 INFO:teuthology.orchestra.run.smithi135.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip [following] 2019-11-25T09:39:51.559 INFO:teuthology.orchestra.run.smithi135.stderr:--2019-11-25 09:39:51-- https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip 2019-11-25T09:39:51.570 INFO:teuthology.orchestra.run.smithi135.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.159.20, 104.17.160.20, 2606:4700::6811:9f14, ... 2019-11-25T09:39:51.578 INFO:teuthology.orchestra.run.smithi135.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.159.20|:443... connected. 2019-11-25T09:39:51.626 INFO:teuthology.orchestra.run.smithi135.stderr:HTTP request sent, awaiting response... 200 OK 2019-11-25T09:39:51.626 INFO:teuthology.orchestra.run.smithi135.stderr:Length: 75323957 (72M) [application/zip] 2019-11-25T09:39:51.627 INFO:teuthology.orchestra.run.smithi135.stderr:Saving to: ‘gradle-4.7-bin.zip’ 2019-11-25T09:39:51.627 INFO:teuthology.orchestra.run.smithi135.stderr: 2019-11-25T09:39:51.634 INFO:teuthology.orchestra.run.smithi135.stderr: 0K .......... .......... .......... .......... .......... 0% 6.55M 11s 2019-11-25T09:39:51.634 INFO:teuthology.orchestra.run.smithi135.stderr: 50K .......... .......... .......... .......... .......... 0% 87.8M 6s 2019-11-25T09:39:51.641 INFO:teuthology.orchestra.run.smithi135.stderr: 100K .......... .......... .......... .......... .......... 0% 7.41M 7s 2019-11-25T09:39:51.641 INFO:teuthology.orchestra.run.smithi135.stderr: 150K .......... .......... .......... .......... .......... 0% 75.4M 6s 2019-11-25T09:39:51.642 INFO:teuthology.orchestra.run.smithi135.stderr: 200K .......... .......... .......... .......... .......... 0% 108M 5s 2019-11-25T09:39:51.646 INFO:teuthology.orchestra.run.smithi135.stderr: 250K .......... .......... .......... .......... .......... 0% 7.22M 5s 2019-11-25T09:39:52.753 INFO:teuthology.orchestra.run.smithi135.stderr: 300K .......... .......... .......... .......... .......... 0% 145M 5s 2019-11-25T09:39:52.753 INFO:teuthology.orchestra.run.smithi135.stderr: 350K .......... .......... .......... .......... .......... 0% 125M 4s 2019-11-25T09:39:52.753 INFO:teuthology.orchestra.run.smithi135.stderr: 400K .......... .......... .......... .......... .......... 0% 119M 4s 2019-11-25T09:39:52.753 INFO:teuthology.orchestra.run.smithi135.stderr: 450K .......... .......... .......... .......... .......... 0% 122M 4s 2019-11-25T09:39:52.753 INFO:teuthology.orchestra.run.smithi135.stderr: 500K .......... .......... .......... .......... .......... 0% 124M 3s 2019-11-25T09:39:52.754 INFO:teuthology.orchestra.run.smithi135.stderr: 550K .......... .......... .......... .......... .......... 0% 104M 3s 2019-11-25T09:39:52.754 INFO:teuthology.orchestra.run.smithi135.stderr: 600K .......... .......... .......... .......... .......... 0% 148M 3s 2019-11-25T09:39:52.754 INFO:teuthology.orchestra.run.smithi135.stderr: 650K .......... .......... .......... .......... .......... 0% 153M 3s 2019-11-25T09:39:52.754 INFO:teuthology.orchestra.run.smithi135.stderr: 700K .......... .......... .......... .......... .......... 1% 10.5M 3s 2019-11-25T09:39:52.754 INFO:teuthology.orchestra.run.smithi135.stderr: 750K .......... .......... .......... .......... .......... 1% 150M 3s 2019-11-25T09:39:52.754 INFO:teuthology.orchestra.run.smithi135.stderr: 800K .......... .......... .......... .......... .......... 1% 129M 3s 2019-11-25T09:39:52.754 INFO:teuthology.orchestra.run.smithi135.stderr: 850K .......... .......... .......... .......... .......... 1% 137M 3s 2019-11-25T09:39:52.755 INFO:teuthology.orchestra.run.smithi135.stderr: 900K .......... .......... .......... .......... .......... 1% 106M 2s 2019-11-25T09:39:52.755 INFO:teuthology.orchestra.run.smithi135.stderr: 950K .......... .......... .......... .......... .......... 1% 131M 2s 2019-11-25T09:39:52.755 INFO:teuthology.orchestra.run.smithi135.stderr: 1000K .......... .......... .......... .......... .......... 1% 136M 2s 2019-11-25T09:39:52.755 INFO:teuthology.orchestra.run.smithi135.stderr: 1050K .......... .......... .......... .......... .......... 1% 128M 2s 2019-11-25T09:39:52.755 INFO:teuthology.orchestra.run.smithi135.stderr: 1100K .......... .......... .......... .......... .......... 1% 134M 2s 2019-11-25T09:39:52.755 INFO:teuthology.orchestra.run.smithi135.stderr: 1150K .......... .......... .......... .......... .......... 1% 108M 2s 2019-11-25T09:39:52.755 INFO:teuthology.orchestra.run.smithi135.stderr: 1200K .......... .......... .......... .......... .......... 1% 117M 2s 2019-11-25T09:39:52.756 INFO:teuthology.orchestra.run.smithi135.stderr: 1250K .......... .......... .......... .......... .......... 1% 126M 2s 2019-11-25T09:39:52.756 INFO:teuthology.orchestra.run.smithi135.stderr: 1300K .......... .......... .......... .......... .......... 1% 16.0M 2s 2019-11-25T09:39:52.756 INFO:teuthology.orchestra.run.smithi135.stderr: 1350K .......... .......... .......... .......... .......... 1% 112M 2s 2019-11-25T09:39:52.756 INFO:teuthology.orchestra.run.smithi135.stderr: 1400K .......... .......... .......... .......... .......... 1% 171M 2s 2019-11-25T09:39:52.756 INFO:teuthology.orchestra.run.smithi135.stderr: 1450K .......... .......... .......... .......... .......... 2% 173M 2s 2019-11-25T09:39:52.756 INFO:teuthology.orchestra.run.smithi135.stderr: 1500K .......... .......... .......... .......... .......... 2% 167M 2s 2019-11-25T09:39:52.756 INFO:teuthology.orchestra.run.smithi135.stderr: 1550K .......... .......... .......... .......... .......... 2% 140M 2s 2019-11-25T09:39:52.757 INFO:teuthology.orchestra.run.smithi135.stderr: 1600K .......... .......... .......... .......... .......... 2% 171M 2s 2019-11-25T09:39:52.757 INFO:teuthology.orchestra.run.smithi135.stderr: 1650K .......... .......... .......... .......... .......... 2% 170M 2s 2019-11-25T09:39:52.757 INFO:teuthology.orchestra.run.smithi135.stderr: 1700K .......... .......... .......... .......... .......... 2% 165M 2s 2019-11-25T09:39:52.757 INFO:teuthology.orchestra.run.smithi135.stderr: 1750K .......... .......... .......... .......... .......... 2% 142M 2s 2019-11-25T09:39:52.757 INFO:teuthology.orchestra.run.smithi135.stderr: 1800K .......... .......... .......... .......... .......... 2% 179M 2s 2019-11-25T09:39:52.757 INFO:teuthology.orchestra.run.smithi135.stderr: 1850K .......... .......... .......... .......... .......... 2% 170M 2s 2019-11-25T09:39:52.757 INFO:teuthology.orchestra.run.smithi135.stderr: 1900K .......... .......... .......... .......... .......... 2% 173M 2s 2019-11-25T09:39:52.758 INFO:teuthology.orchestra.run.smithi135.stderr: 1950K .......... .......... .......... .......... .......... 2% 129M 1s 2019-11-25T09:39:52.758 INFO:teuthology.orchestra.run.smithi135.stderr: 2000K .......... .......... .......... .......... .......... 2% 150M 1s 2019-11-25T09:39:52.758 INFO:teuthology.orchestra.run.smithi135.stderr: 2050K .......... .......... .......... .......... .......... 2% 159M 1s 2019-11-25T09:39:52.758 INFO:teuthology.orchestra.run.smithi135.stderr: 2100K .......... .......... .......... .......... .......... 2% 176M 1s 2019-11-25T09:39:52.758 INFO:teuthology.orchestra.run.smithi135.stderr: 2150K .......... .......... .......... .......... .......... 2% 149M 1s 2019-11-25T09:39:52.758 INFO:teuthology.orchestra.run.smithi135.stderr: 2200K .......... .......... .......... .......... .......... 3% 186M 1s 2019-11-25T09:39:52.758 INFO:teuthology.orchestra.run.smithi135.stderr: 2250K .......... .......... .......... .......... .......... 3% 192M 1s 2019-11-25T09:39:52.759 INFO:teuthology.orchestra.run.smithi135.stderr: 2300K .......... .......... .......... .......... .......... 3% 182M 1s 2019-11-25T09:39:52.759 INFO:teuthology.orchestra.run.smithi135.stderr: 2350K .......... .......... .......... .......... .......... 3% 150M 1s 2019-11-25T09:39:52.759 INFO:teuthology.orchestra.run.smithi135.stderr: 2400K .......... .......... .......... .......... .......... 3% 200M 1s 2019-11-25T09:39:52.759 INFO:teuthology.orchestra.run.smithi135.stderr: 2450K .......... .......... .......... .......... .......... 3% 195M 1s 2019-11-25T09:39:52.759 INFO:teuthology.orchestra.run.smithi135.stderr: 2500K .......... .......... .......... .......... .......... 3% 199M 1s 2019-11-25T09:39:52.759 INFO:teuthology.orchestra.run.smithi135.stderr: 2550K .......... .......... .......... .......... .......... 3% 160M 1s 2019-11-25T09:39:52.759 INFO:teuthology.orchestra.run.smithi135.stderr: 2600K .......... .......... .......... .......... .......... 3% 134M 1s 2019-11-25T09:39:52.760 INFO:teuthology.orchestra.run.smithi135.stderr: 2650K .......... .......... .......... .......... .......... 3% 168M 1s 2019-11-25T09:39:52.760 INFO:teuthology.orchestra.run.smithi135.stderr: 2700K .......... .......... .......... .......... .......... 3% 159M 1s 2019-11-25T09:39:52.760 INFO:teuthology.orchestra.run.smithi135.stderr: 2750K .......... .......... .......... .......... .......... 3% 162M 1s 2019-11-25T09:39:52.760 INFO:teuthology.orchestra.run.smithi135.stderr: 2800K .......... .......... .......... .......... .......... 3% 164M 1s 2019-11-25T09:39:52.760 INFO:teuthology.orchestra.run.smithi135.stderr: 2850K .......... .......... .......... .......... .......... 3% 155M 1s 2019-11-25T09:39:52.760 INFO:teuthology.orchestra.run.smithi135.stderr: 2900K .......... .......... .......... .......... .......... 4% 201M 1s 2019-11-25T09:39:52.760 INFO:teuthology.orchestra.run.smithi135.stderr: 2950K .......... .......... .......... .......... .......... 4% 155M 1s 2019-11-25T09:39:52.761 INFO:teuthology.orchestra.run.smithi135.stderr: 3000K .......... .......... .......... .......... .......... 4% 150M 1s 2019-11-25T09:39:52.761 INFO:teuthology.orchestra.run.smithi135.stderr: 3050K .......... .......... .......... .......... .......... 4% 153M 1s 2019-11-25T09:39:52.761 INFO:teuthology.orchestra.run.smithi135.stderr: 3100K .......... .......... .......... .......... .......... 4% 194M 1s 2019-11-25T09:39:52.761 INFO:teuthology.orchestra.run.smithi135.stderr: 3150K .......... .......... .......... .......... .......... 4% 164M 1s 2019-11-25T09:39:52.761 INFO:teuthology.orchestra.run.smithi135.stderr: 3200K .......... .......... .......... .......... .......... 4% 134M 1s 2019-11-25T09:39:52.761 INFO:teuthology.orchestra.run.smithi135.stderr: 3250K .......... .......... .......... .......... .......... 4% 138M 1s 2019-11-25T09:39:52.761 INFO:teuthology.orchestra.run.smithi135.stderr: 3300K .......... .......... .......... .......... .......... 4% 138M 1s 2019-11-25T09:39:52.762 INFO:teuthology.orchestra.run.smithi135.stderr: 3350K .......... .......... .......... .......... .......... 4% 121M 1s 2019-11-25T09:39:52.762 INFO:teuthology.orchestra.run.smithi135.stderr: 3400K .......... .......... .......... .......... .......... 4% 140M 1s 2019-11-25T09:39:52.762 INFO:teuthology.orchestra.run.smithi135.stderr: 3450K .......... .......... .......... .......... .......... 4% 129M 1s 2019-11-25T09:39:52.762 INFO:teuthology.orchestra.run.smithi135.stderr: 3500K .......... .......... .......... .......... .......... 4% 144M 1s 2019-11-25T09:39:52.762 INFO:teuthology.orchestra.run.smithi135.stderr: 3550K .......... .......... .......... .......... .......... 4% 120M 1s 2019-11-25T09:39:52.762 INFO:teuthology.orchestra.run.smithi135.stderr: 3600K .......... .......... .......... .......... .......... 4% 136M 1s 2019-11-25T09:39:52.762 INFO:teuthology.orchestra.run.smithi135.stderr: 3650K .......... .......... .......... .......... .......... 5% 144M 1s 2019-11-25T09:39:52.763 INFO:teuthology.orchestra.run.smithi135.stderr: 3700K .......... .......... .......... .......... .......... 5% 146M 1s 2019-11-25T09:39:52.763 INFO:teuthology.orchestra.run.smithi135.stderr: 3750K .......... .......... .......... .......... .......... 5% 114M 1s 2019-11-25T09:39:52.763 INFO:teuthology.orchestra.run.smithi135.stderr: 3800K .......... .......... .......... .......... .......... 5% 134M 1s 2019-11-25T09:39:52.763 INFO:teuthology.orchestra.run.smithi135.stderr: 3850K .......... .......... .......... .......... .......... 5% 137M 1s 2019-11-25T09:39:52.763 INFO:teuthology.orchestra.run.smithi135.stderr: 3900K .......... .......... .......... .......... .......... 5% 134M 1s 2019-11-25T09:39:52.763 INFO:teuthology.orchestra.run.smithi135.stderr: 3950K .......... .......... .......... .......... .......... 5% 117M 1s 2019-11-25T09:39:52.763 INFO:teuthology.orchestra.run.smithi135.stderr: 4000K .......... .......... .......... .......... .......... 5% 149M 1s 2019-11-25T09:39:52.763 INFO:teuthology.orchestra.run.smithi135.stderr: 4050K .......... .......... .......... .......... .......... 5% 138M 1s 2019-11-25T09:39:52.764 INFO:teuthology.orchestra.run.smithi135.stderr: 4100K .......... .......... .......... .......... .......... 5% 146M 1s 2019-11-25T09:39:52.764 INFO:teuthology.orchestra.run.smithi135.stderr: 4150K .......... .......... .......... .......... .......... 5% 131M 1s 2019-11-25T09:39:52.764 INFO:teuthology.orchestra.run.smithi135.stderr: 4200K .......... .......... .......... .......... .......... 5% 144M 1s 2019-11-25T09:39:52.764 INFO:teuthology.orchestra.run.smithi135.stderr: 4250K .......... .......... .......... .......... .......... 5% 149M 1s 2019-11-25T09:39:52.764 INFO:teuthology.orchestra.run.smithi135.stderr: 4300K .......... .......... .......... .......... .......... 5% 151M 1s 2019-11-25T09:39:52.764 INFO:teuthology.orchestra.run.smithi135.stderr: 4350K .......... .......... .......... .......... .......... 5% 118M 1s 2019-11-25T09:39:52.764 INFO:teuthology.orchestra.run.smithi135.stderr: 4400K .......... .......... .......... .......... .......... 6% 148M 1s 2019-11-25T09:39:52.765 INFO:teuthology.orchestra.run.smithi135.stderr: 4450K .......... .......... .......... .......... .......... 6% 141M 1s 2019-11-25T09:39:52.765 INFO:teuthology.orchestra.run.smithi135.stderr: 4500K .......... .......... .......... .......... .......... 6% 145M 1s 2019-11-25T09:39:52.765 INFO:teuthology.orchestra.run.smithi135.stderr: 4550K .......... .......... .......... .......... .......... 6% 120M 1s 2019-11-25T09:39:52.765 INFO:teuthology.orchestra.run.smithi135.stderr: 4600K .......... .......... .......... .......... .......... 6% 143M 1s 2019-11-25T09:39:52.765 INFO:teuthology.orchestra.run.smithi135.stderr: 4650K .......... .......... .......... .......... .......... 6% 138M 1s 2019-11-25T09:39:52.765 INFO:teuthology.orchestra.run.smithi135.stderr: 4700K .......... .......... .......... .......... .......... 6% 126M 1s 2019-11-25T09:39:52.765 INFO:teuthology.orchestra.run.smithi135.stderr: 4750K .......... .......... .......... .......... .......... 6% 104M 1s 2019-11-25T09:39:52.766 INFO:teuthology.orchestra.run.smithi135.stderr: 4800K .......... .......... .......... .......... .......... 6% 94.0M 1s 2019-11-25T09:39:52.766 INFO:teuthology.orchestra.run.smithi135.stderr: 4850K .......... .......... .......... .......... .......... 6% 111M 1s 2019-11-25T09:39:52.766 INFO:teuthology.orchestra.run.smithi135.stderr: 4900K .......... .......... .......... .......... .......... 6% 148M 1s 2019-11-25T09:39:52.766 INFO:teuthology.orchestra.run.smithi135.stderr: 4950K .......... .......... .......... .......... .......... 6% 121M 1s 2019-11-25T09:39:52.766 INFO:teuthology.orchestra.run.smithi135.stderr: 5000K .......... .......... .......... .......... .......... 6% 144M 1s 2019-11-25T09:39:52.766 INFO:teuthology.orchestra.run.smithi135.stderr: 5050K .......... .......... .......... .......... .......... 6% 149M 1s 2019-11-25T09:39:52.766 INFO:teuthology.orchestra.run.smithi135.stderr: 5100K .......... .......... .......... .......... .......... 7% 142M 1s 2019-11-25T09:39:52.767 INFO:teuthology.orchestra.run.smithi135.stderr: 5150K .......... .......... .......... .......... .......... 7% 128M 1s 2019-11-25T09:39:52.767 INFO:teuthology.orchestra.run.smithi135.stderr: 5200K .......... .......... .......... .......... .......... 7% 141M 1s 2019-11-25T09:39:52.767 INFO:teuthology.orchestra.run.smithi135.stderr: 5250K .......... .......... .......... .......... .......... 7% 140M 1s 2019-11-25T09:39:52.767 INFO:teuthology.orchestra.run.smithi135.stderr: 5300K .......... .......... .......... .......... .......... 7% 151M 1s 2019-11-25T09:39:52.767 INFO:teuthology.orchestra.run.smithi135.stderr: 5350K .......... .......... .......... .......... .......... 7% 123M 1s 2019-11-25T09:39:52.767 INFO:teuthology.orchestra.run.smithi135.stderr: 5400K .......... .......... .......... .......... .......... 7% 163M 1s 2019-11-25T09:39:52.767 INFO:teuthology.orchestra.run.smithi135.stderr: 5450K .......... .......... .......... .......... .......... 7% 162M 1s 2019-11-25T09:39:52.768 INFO:teuthology.orchestra.run.smithi135.stderr: 5500K .......... .......... .......... .......... .......... 7% 152M 1s 2019-11-25T09:39:52.768 INFO:teuthology.orchestra.run.smithi135.stderr: 5550K .......... .......... .......... .......... .......... 7% 133M 1s 2019-11-25T09:39:52.768 INFO:teuthology.orchestra.run.smithi135.stderr: 5600K .......... .......... .......... .......... .......... 7% 152M 1s 2019-11-25T09:39:52.768 INFO:teuthology.orchestra.run.smithi135.stderr: 5650K .......... .......... .......... .......... .......... 7% 155M 1s 2019-11-25T09:39:52.768 INFO:teuthology.orchestra.run.smithi135.stderr: 5700K .......... .......... .......... .......... .......... 7% 143M 1s 2019-11-25T09:39:52.768 INFO:teuthology.orchestra.run.smithi135.stderr: 5750K .......... .......... .......... .......... .......... 7% 126M 1s 2019-11-25T09:39:52.768 INFO:teuthology.orchestra.run.smithi135.stderr: 5800K .......... .......... .......... .......... .......... 7% 142M 1s 2019-11-25T09:39:52.769 INFO:teuthology.orchestra.run.smithi135.stderr: 5850K .......... .......... .......... .......... .......... 8% 155M 1s 2019-11-25T09:39:52.769 INFO:teuthology.orchestra.run.smithi135.stderr: 5900K .......... .......... .......... .......... .......... 8% 158M 1s 2019-11-25T09:39:52.769 INFO:teuthology.orchestra.run.smithi135.stderr: 5950K .......... .......... .......... .......... .......... 8% 135M 1s 2019-11-25T09:39:52.769 INFO:teuthology.orchestra.run.smithi135.stderr: 6000K .......... .......... .......... .......... .......... 8% 151M 1s 2019-11-25T09:39:52.769 INFO:teuthology.orchestra.run.smithi135.stderr: 6050K .......... .......... .......... .......... .......... 8% 197M 1s 2019-11-25T09:39:52.769 INFO:teuthology.orchestra.run.smithi135.stderr: 6100K .......... .......... .......... .......... .......... 8% 115M 1s 2019-11-25T09:39:52.769 INFO:teuthology.orchestra.run.smithi135.stderr: 6150K .......... .......... .......... .......... .......... 8% 126M 1s 2019-11-25T09:39:52.770 INFO:teuthology.orchestra.run.smithi135.stderr: 6200K .......... .......... .......... .......... .......... 8% 127M 1s 2019-11-25T09:39:52.770 INFO:teuthology.orchestra.run.smithi135.stderr: 6250K .......... .......... .......... .......... .......... 8% 151M 1s 2019-11-25T09:39:52.770 INFO:teuthology.orchestra.run.smithi135.stderr: 6300K .......... .......... .......... .......... .......... 8% 221M 1s 2019-11-25T09:39:52.770 INFO:teuthology.orchestra.run.smithi135.stderr: 6350K .......... .......... .......... .......... .......... 8% 160M 1s 2019-11-25T09:39:52.770 INFO:teuthology.orchestra.run.smithi135.stderr: 6400K .......... .......... .......... .......... .......... 8% 221M 1s 2019-11-25T09:39:52.770 INFO:teuthology.orchestra.run.smithi135.stderr: 6450K .......... .......... .......... .......... .......... 8% 178M 1s 2019-11-25T09:39:52.770 INFO:teuthology.orchestra.run.smithi135.stderr: 6500K .......... .......... .......... .......... .......... 8% 171M 1s 2019-11-25T09:39:52.771 INFO:teuthology.orchestra.run.smithi135.stderr: 6550K .......... .......... .......... .......... .......... 8% 187M 1s 2019-11-25T09:39:52.771 INFO:teuthology.orchestra.run.smithi135.stderr: 6600K .......... .......... .......... .......... .......... 9% 222M 1s 2019-11-25T09:39:52.771 INFO:teuthology.orchestra.run.smithi135.stderr: 6650K .......... .......... .......... .......... .......... 9% 138M 1s 2019-11-25T09:39:52.771 INFO:teuthology.orchestra.run.smithi135.stderr: 6700K .......... .......... .......... .......... .......... 9% 111M 1s 2019-11-25T09:39:52.771 INFO:teuthology.orchestra.run.smithi135.stderr: 6750K .......... .......... .......... .......... .......... 9% 122M 1s 2019-11-25T09:39:52.771 INFO:teuthology.orchestra.run.smithi135.stderr: 6800K .......... .......... .......... .......... .......... 9% 133M 1s 2019-11-25T09:39:52.771 INFO:teuthology.orchestra.run.smithi135.stderr: 6850K .......... .......... .......... .......... .......... 9% 134M 1s 2019-11-25T09:39:52.772 INFO:teuthology.orchestra.run.smithi135.stderr: 6900K .......... .......... .......... .......... .......... 9% 103M 1s 2019-11-25T09:39:52.772 INFO:teuthology.orchestra.run.smithi135.stderr: 6950K .......... .......... .......... .......... .......... 9% 123M 1s 2019-11-25T09:39:52.772 INFO:teuthology.orchestra.run.smithi135.stderr: 7000K .......... .......... .......... .......... .......... 9% 191M 1s 2019-11-25T09:39:52.772 INFO:teuthology.orchestra.run.smithi135.stderr: 7050K .......... .......... .......... .......... .......... 9% 189M 1s 2019-11-25T09:39:52.772 INFO:teuthology.orchestra.run.smithi135.stderr: 7100K .......... .......... .......... .......... .......... 9% 165M 1s 2019-11-25T09:39:52.772 INFO:teuthology.orchestra.run.smithi135.stderr: 7150K .......... .......... .......... .......... .......... 9% 211M 1s 2019-11-25T09:39:52.772 INFO:teuthology.orchestra.run.smithi135.stderr: 7200K .......... .......... .......... .......... .......... 9% 239M 1s 2019-11-25T09:39:52.772 INFO:teuthology.orchestra.run.smithi135.stderr: 7250K .......... .......... .......... .......... .......... 9% 227M 1s 2019-11-25T09:39:52.773 INFO:teuthology.orchestra.run.smithi135.stderr: 7300K .......... .......... .......... .......... .......... 9% 216M 1s 2019-11-25T09:39:52.773 INFO:teuthology.orchestra.run.smithi135.stderr: 7350K .......... .......... .......... .......... .......... 10% 177M 1s 2019-11-25T09:39:52.773 INFO:teuthology.orchestra.run.smithi135.stderr: 7400K .......... .......... .......... .......... .......... 10% 149M 1s 2019-11-25T09:39:52.773 INFO:teuthology.orchestra.run.smithi135.stderr: 7450K .......... .......... .......... .......... .......... 10% 131M 1s 2019-11-25T09:39:52.773 INFO:teuthology.orchestra.run.smithi135.stderr: 7500K .......... .......... .......... .......... .......... 10% 137M 1s 2019-11-25T09:39:52.773 INFO:teuthology.orchestra.run.smithi135.stderr: 7550K .......... .......... .......... .......... .......... 10% 112M 1s 2019-11-25T09:39:52.773 INFO:teuthology.orchestra.run.smithi135.stderr: 7600K .......... .......... .......... .......... .......... 10% 132M 1s 2019-11-25T09:39:52.774 INFO:teuthology.orchestra.run.smithi135.stderr: 7650K .......... .......... .......... .......... .......... 10% 133M 1s 2019-11-25T09:39:52.774 INFO:teuthology.orchestra.run.smithi135.stderr: 7700K .......... .......... .......... .......... .......... 10% 188M 1s 2019-11-25T09:39:52.774 INFO:teuthology.orchestra.run.smithi135.stderr: 7750K .......... .......... .......... .......... .......... 10% 137M 1s 2019-11-25T09:39:52.774 INFO:teuthology.orchestra.run.smithi135.stderr: 7800K .......... .......... .......... .......... .......... 10% 237M 1s 2019-11-25T09:39:52.774 INFO:teuthology.orchestra.run.smithi135.stderr: 7850K .......... .......... .......... .......... .......... 10% 213M 1s 2019-11-25T09:39:52.774 INFO:teuthology.orchestra.run.smithi135.stderr: 7900K .......... .......... .......... .......... .......... 10% 214M 1s 2019-11-25T09:39:52.774 INFO:teuthology.orchestra.run.smithi135.stderr: 7950K .......... .......... .......... .......... .......... 10% 209M 1s 2019-11-25T09:39:52.775 INFO:teuthology.orchestra.run.smithi135.stderr: 8000K .......... .......... .......... .......... .......... 10% 234M 1s 2019-11-25T09:39:52.775 INFO:teuthology.orchestra.run.smithi135.stderr: 8050K .......... .......... .......... .......... .......... 11% 237M 1s 2019-11-25T09:39:52.775 INFO:teuthology.orchestra.run.smithi135.stderr: 8100K .......... .......... .......... .......... .......... 11% 231M 1s 2019-11-25T09:39:52.775 INFO:teuthology.orchestra.run.smithi135.stderr: 8150K .......... .......... .......... .......... .......... 11% 202M 1s 2019-11-25T09:39:52.775 INFO:teuthology.orchestra.run.smithi135.stderr: 8200K .......... .......... .......... .......... .......... 11% 242M 1s 2019-11-25T09:39:52.775 INFO:teuthology.orchestra.run.smithi135.stderr: 8250K .......... .......... .......... .......... .......... 11% 245M 1s 2019-11-25T09:39:52.775 INFO:teuthology.orchestra.run.smithi135.stderr: 8300K .......... .......... .......... .......... .......... 11% 244M 1s 2019-11-25T09:39:52.776 INFO:teuthology.orchestra.run.smithi135.stderr: 8350K .......... .......... .......... .......... .......... 11% 123M 1s 2019-11-25T09:39:52.776 INFO:teuthology.orchestra.run.smithi135.stderr: 8400K .......... .......... .......... .......... .......... 11% 165M 1s 2019-11-25T09:39:52.776 INFO:teuthology.orchestra.run.smithi135.stderr: 8450K .......... .......... .......... .......... .......... 11% 161M 1s 2019-11-25T09:39:52.776 INFO:teuthology.orchestra.run.smithi135.stderr: 8500K .......... .......... .......... .......... .......... 11% 163M 1s 2019-11-25T09:39:52.776 INFO:teuthology.orchestra.run.smithi135.stderr: 8550K .......... .......... .......... .......... .......... 11% 132M 1s 2019-11-25T09:39:52.776 INFO:teuthology.orchestra.run.smithi135.stderr: 8600K .......... .......... .......... .......... .......... 11% 154M 1s 2019-11-25T09:39:52.776 INFO:teuthology.orchestra.run.smithi135.stderr: 8650K .......... .......... .......... .......... .......... 11% 147M 1s 2019-11-25T09:39:52.777 INFO:teuthology.orchestra.run.smithi135.stderr: 8700K .......... .......... .......... .......... .......... 11% 148M 1s 2019-11-25T09:39:52.777 INFO:teuthology.orchestra.run.smithi135.stderr: 8750K .......... .......... .......... .......... .......... 11% 159M 1s 2019-11-25T09:39:52.777 INFO:teuthology.orchestra.run.smithi135.stderr: 8800K .......... .......... .......... .......... .......... 12% 158M 1s 2019-11-25T09:39:52.777 INFO:teuthology.orchestra.run.smithi135.stderr: 8850K .......... .......... .......... .......... .......... 12% 170M 1s 2019-11-25T09:39:52.777 INFO:teuthology.orchestra.run.smithi135.stderr: 8900K .......... .......... .......... .......... .......... 12% 172M 1s 2019-11-25T09:39:52.777 INFO:teuthology.orchestra.run.smithi135.stderr: 8950K .......... .......... .......... .......... .......... 12% 140M 1s 2019-11-25T09:39:52.777 INFO:teuthology.orchestra.run.smithi135.stderr: 9000K .......... .......... .......... .......... .......... 12% 174M 1s 2019-11-25T09:39:52.778 INFO:teuthology.orchestra.run.smithi135.stderr: 9050K .......... .......... .......... .......... .......... 12% 171M 1s 2019-11-25T09:39:52.778 INFO:teuthology.orchestra.run.smithi135.stderr: 9100K .......... .......... .......... .......... .......... 12% 180M 1s 2019-11-25T09:39:52.778 INFO:teuthology.orchestra.run.smithi135.stderr: 9150K .......... .......... .......... .......... .......... 12% 152M 1s 2019-11-25T09:39:52.778 INFO:teuthology.orchestra.run.smithi135.stderr: 9200K .......... .......... .......... .......... .......... 12% 162M 1s 2019-11-25T09:39:52.778 INFO:teuthology.orchestra.run.smithi135.stderr: 9250K .......... .......... .......... .......... .......... 12% 164M 1s 2019-11-25T09:39:52.778 INFO:teuthology.orchestra.run.smithi135.stderr: 9300K .......... .......... .......... .......... .......... 12% 148M 1s 2019-11-25T09:39:52.778 INFO:teuthology.orchestra.run.smithi135.stderr: 9350K .......... .......... .......... .......... .......... 12% 131M 1s 2019-11-25T09:39:52.779 INFO:teuthology.orchestra.run.smithi135.stderr: 9400K .......... .......... .......... .......... .......... 12% 151M 1s 2019-11-25T09:39:52.779 INFO:teuthology.orchestra.run.smithi135.stderr: 9450K .......... .......... .......... .......... .......... 12% 159M 1s 2019-11-25T09:39:52.779 INFO:teuthology.orchestra.run.smithi135.stderr: 9500K .......... .......... .......... .......... .......... 12% 167M 1s 2019-11-25T09:39:52.779 INFO:teuthology.orchestra.run.smithi135.stderr: 9550K .......... .......... .......... .......... .......... 13% 147M 1s 2019-11-25T09:39:52.779 INFO:teuthology.orchestra.run.smithi135.stderr: 9600K .......... .......... .......... .......... .......... 13% 158M 1s 2019-11-25T09:39:52.779 INFO:teuthology.orchestra.run.smithi135.stderr: 9650K .......... .......... .......... .......... .......... 13% 169M 1s 2019-11-25T09:39:52.779 INFO:teuthology.orchestra.run.smithi135.stderr: 9700K .......... .......... .......... .......... .......... 13% 164M 1s 2019-11-25T09:39:52.780 INFO:teuthology.orchestra.run.smithi135.stderr: 9750K .......... .......... .......... .......... .......... 13% 141M 1s 2019-11-25T09:39:52.780 INFO:teuthology.orchestra.run.smithi135.stderr: 9800K .......... .......... .......... .......... .......... 13% 163M 1s 2019-11-25T09:39:52.780 INFO:teuthology.orchestra.run.smithi135.stderr: 9850K .......... .......... .......... .......... .......... 13% 171M 1s 2019-11-25T09:39:52.780 INFO:teuthology.orchestra.run.smithi135.stderr: 9900K .......... .......... .......... .......... .......... 13% 179M 1s 2019-11-25T09:39:52.780 INFO:teuthology.orchestra.run.smithi135.stderr: 9950K .......... .......... .......... .......... .......... 13% 150M 1s 2019-11-25T09:39:52.780 INFO:teuthology.orchestra.run.smithi135.stderr: 10000K .......... .......... .......... .......... .......... 13% 175M 1s 2019-11-25T09:39:52.780 INFO:teuthology.orchestra.run.smithi135.stderr: 10050K .......... .......... .......... .......... .......... 13% 171M 1s 2019-11-25T09:39:52.780 INFO:teuthology.orchestra.run.smithi135.stderr: 10100K .......... .......... .......... .......... .......... 13% 170M 1s 2019-11-25T09:39:52.781 INFO:teuthology.orchestra.run.smithi135.stderr: 10150K .......... .......... .......... .......... .......... 13% 145M 1s 2019-11-25T09:39:52.781 INFO:teuthology.orchestra.run.smithi135.stderr: 10200K .......... .......... .......... .......... .......... 13% 159M 1s 2019-11-25T09:39:52.781 INFO:teuthology.orchestra.run.smithi135.stderr: 10250K .......... .......... .......... .......... .......... 14% 171M 1s 2019-11-25T09:39:52.781 INFO:teuthology.orchestra.run.smithi135.stderr: 10300K .......... .......... .......... .......... .......... 14% 161M 1s 2019-11-25T09:39:52.781 INFO:teuthology.orchestra.run.smithi135.stderr: 10350K .......... .......... .......... .......... .......... 14% 149M 1s 2019-11-25T09:39:52.781 INFO:teuthology.orchestra.run.smithi135.stderr: 10400K .......... .......... .......... .......... .......... 14% 176M 1s 2019-11-25T09:39:52.781 INFO:teuthology.orchestra.run.smithi135.stderr: 10450K .......... .......... .......... .......... .......... 14% 172M 1s 2019-11-25T09:39:52.783 INFO:teuthology.orchestra.run.smithi135.stderr: 10500K .......... .......... .......... .......... .......... 14% 177M 1s 2019-11-25T09:39:52.783 INFO:teuthology.orchestra.run.smithi135.stderr: 10550K .......... .......... .......... .......... .......... 14% 134M 1s 2019-11-25T09:39:52.783 INFO:teuthology.orchestra.run.smithi135.stderr: 10600K .......... .......... .......... .......... .......... 14% 176M 1s 2019-11-25T09:39:52.783 INFO:teuthology.orchestra.run.smithi135.stderr: 10650K .......... .......... .......... .......... .......... 14% 177M 1s 2019-11-25T09:39:52.784 INFO:teuthology.orchestra.run.smithi135.stderr: 10700K .......... .......... .......... .......... .......... 14% 181M 1s 2019-11-25T09:39:52.784 INFO:teuthology.orchestra.run.smithi135.stderr: 10750K .......... .......... .......... .......... .......... 14% 164M 1s 2019-11-25T09:39:52.784 INFO:teuthology.orchestra.run.smithi135.stderr: 10800K .......... .......... .......... .......... .......... 14% 159M 1s 2019-11-25T09:39:52.784 INFO:teuthology.orchestra.run.smithi135.stderr: 10850K .......... .......... .......... .......... .......... 14% 175M 1s 2019-11-25T09:39:52.784 INFO:teuthology.orchestra.run.smithi135.stderr: 10900K .......... .......... .......... .......... .......... 14% 178M 1s 2019-11-25T09:39:52.784 INFO:teuthology.orchestra.run.smithi135.stderr: 10950K .......... .......... .......... .......... .......... 14% 139M 1s 2019-11-25T09:39:52.784 INFO:teuthology.orchestra.run.smithi135.stderr: 11000K .......... .......... .......... .......... .......... 15% 183M 1s 2019-11-25T09:39:52.785 INFO:teuthology.orchestra.run.smithi135.stderr: 11050K .......... .......... .......... .......... .......... 15% 164M 1s 2019-11-25T09:39:52.785 INFO:teuthology.orchestra.run.smithi135.stderr: 11100K .......... .......... .......... .......... .......... 15% 161M 1s 2019-11-25T09:39:52.785 INFO:teuthology.orchestra.run.smithi135.stderr: 11150K .......... .......... .......... .......... .......... 15% 162M 1s 2019-11-25T09:39:52.785 INFO:teuthology.orchestra.run.smithi135.stderr: 11200K .......... .......... .......... .......... .......... 15% 180M 1s 2019-11-25T09:39:52.785 INFO:teuthology.orchestra.run.smithi135.stderr: 11250K .......... .......... .......... .......... .......... 15% 178M 1s 2019-11-25T09:39:52.785 INFO:teuthology.orchestra.run.smithi135.stderr: 11300K .......... .......... .......... .......... .......... 15% 179M 1s 2019-11-25T09:39:52.785 INFO:teuthology.orchestra.run.smithi135.stderr: 11350K .......... .......... .......... .......... .......... 15% 153M 1s 2019-11-25T09:39:52.786 INFO:teuthology.orchestra.run.smithi135.stderr: 11400K .......... .......... .......... .......... .......... 15% 173M 1s 2019-11-25T09:39:52.786 INFO:teuthology.orchestra.run.smithi135.stderr: 11450K .......... .......... .......... .......... .......... 15% 185M 1s 2019-11-25T09:39:52.786 INFO:teuthology.orchestra.run.smithi135.stderr: 11500K .......... .......... .......... .......... .......... 15% 175M 1s 2019-11-25T09:39:52.786 INFO:teuthology.orchestra.run.smithi135.stderr: 11550K .......... .......... .......... .......... .......... 15% 165M 1s 2019-11-25T09:39:52.786 INFO:teuthology.orchestra.run.smithi135.stderr: 11600K .......... .......... .......... .......... .......... 15% 180M 1s 2019-11-25T09:39:52.786 INFO:teuthology.orchestra.run.smithi135.stderr: 11650K .......... .......... .......... .......... .......... 15% 210M 1s 2019-11-25T09:39:52.786 INFO:teuthology.orchestra.run.smithi135.stderr: 11700K .......... .......... .......... .......... .......... 15% 257M 1s 2019-11-25T09:39:52.787 INFO:teuthology.orchestra.run.smithi135.stderr: 11750K .......... .......... .......... .......... .......... 16% 206M 1s 2019-11-25T09:39:52.787 INFO:teuthology.orchestra.run.smithi135.stderr: 11800K .......... .......... .......... .......... .......... 16% 254M 1s 2019-11-25T09:39:52.787 INFO:teuthology.orchestra.run.smithi135.stderr: 11850K .......... .......... .......... .......... .......... 16% 251M 1s 2019-11-25T09:39:52.787 INFO:teuthology.orchestra.run.smithi135.stderr: 11900K .......... .......... .......... .......... .......... 16% 243M 1s 2019-11-25T09:39:52.787 INFO:teuthology.orchestra.run.smithi135.stderr: 11950K .......... .......... .......... .......... .......... 16% 225M 1s 2019-11-25T09:39:52.787 INFO:teuthology.orchestra.run.smithi135.stderr: 12000K .......... .......... .......... .......... .......... 16% 193M 1s 2019-11-25T09:39:52.787 INFO:teuthology.orchestra.run.smithi135.stderr: 12050K .......... .......... .......... .......... .......... 16% 238M 1s 2019-11-25T09:39:52.787 INFO:teuthology.orchestra.run.smithi135.stderr: 12100K .......... .......... .......... .......... .......... 16% 226M 1s 2019-11-25T09:39:52.788 INFO:teuthology.orchestra.run.smithi135.stderr: 12150K .......... .......... .......... .......... .......... 16% 164M 1s 2019-11-25T09:39:52.788 INFO:teuthology.orchestra.run.smithi135.stderr: 12200K .......... .......... .......... .......... .......... 16% 233M 1s 2019-11-25T09:39:52.788 INFO:teuthology.orchestra.run.smithi135.stderr: 12250K .......... .......... .......... .......... .......... 16% 246M 1s 2019-11-25T09:39:52.788 INFO:teuthology.orchestra.run.smithi135.stderr: 12300K .......... .......... .......... .......... .......... 16% 245M 1s 2019-11-25T09:39:52.788 INFO:teuthology.orchestra.run.smithi135.stderr: 12350K .......... .......... .......... .......... .......... 16% 214M 1s 2019-11-25T09:39:52.788 INFO:teuthology.orchestra.run.smithi135.stderr: 12400K .......... .......... .......... .......... .......... 16% 261M 1s 2019-11-25T09:39:52.788 INFO:teuthology.orchestra.run.smithi135.stderr: 12450K .......... .......... .......... .......... .......... 16% 242M 1s 2019-11-25T09:39:52.789 INFO:teuthology.orchestra.run.smithi135.stderr: 12500K .......... .......... .......... .......... .......... 17% 244M 1s 2019-11-25T09:39:52.789 INFO:teuthology.orchestra.run.smithi135.stderr: 12550K .......... .......... .......... .......... .......... 17% 203M 1s 2019-11-25T09:39:52.789 INFO:teuthology.orchestra.run.smithi135.stderr: 12600K .......... .......... .......... .......... .......... 17% 229M 1s 2019-11-25T09:39:52.789 INFO:teuthology.orchestra.run.smithi135.stderr: 12650K .......... .......... .......... .......... .......... 17% 254M 1s 2019-11-25T09:39:52.789 INFO:teuthology.orchestra.run.smithi135.stderr: 12700K .......... .......... .......... .......... .......... 17% 243M 1s 2019-11-25T09:39:52.789 INFO:teuthology.orchestra.run.smithi135.stderr: 12750K .......... .......... .......... .......... .......... 17% 232M 1s 2019-11-25T09:39:52.789 INFO:teuthology.orchestra.run.smithi135.stderr: 12800K .......... .......... .......... .......... .......... 17% 249M 1s 2019-11-25T09:39:52.790 INFO:teuthology.orchestra.run.smithi135.stderr: 12850K .......... .......... .......... .......... .......... 17% 242M 1s 2019-11-25T09:39:52.790 INFO:teuthology.orchestra.run.smithi135.stderr: 12900K .......... .......... .......... .......... .......... 17% 263M 1s 2019-11-25T09:39:52.790 INFO:teuthology.orchestra.run.smithi135.stderr: 12950K .......... .......... .......... .......... .......... 17% 215M 1s 2019-11-25T09:39:52.790 INFO:teuthology.orchestra.run.smithi135.stderr: 13000K .......... .......... .......... .......... .......... 17% 257M 1s 2019-11-25T09:39:52.790 INFO:teuthology.orchestra.run.smithi135.stderr: 13050K .......... .......... .......... .......... .......... 17% 253M 1s 2019-11-25T09:39:52.790 INFO:teuthology.orchestra.run.smithi135.stderr: 13100K .......... .......... .......... .......... .......... 17% 246M 1s 2019-11-25T09:39:52.790 INFO:teuthology.orchestra.run.smithi135.stderr: 13150K .......... .......... .......... .......... .......... 17% 229M 0s 2019-11-25T09:39:52.791 INFO:teuthology.orchestra.run.smithi135.stderr: 13200K .......... .......... .......... .......... .......... 18% 257M 0s 2019-11-25T09:39:52.791 INFO:teuthology.orchestra.run.smithi135.stderr: 13250K .......... .......... .......... .......... .......... 18% 254M 0s 2019-11-25T09:39:52.791 INFO:teuthology.orchestra.run.smithi135.stderr: 13300K .......... .......... .......... .......... .......... 18% 250M 0s 2019-11-25T09:39:52.791 INFO:teuthology.orchestra.run.smithi135.stderr: 13350K .......... .......... .......... .......... .......... 18% 213M 0s 2019-11-25T09:39:52.791 INFO:teuthology.orchestra.run.smithi135.stderr: 13400K .......... .......... .......... .......... .......... 18% 250M 0s 2019-11-25T09:39:52.791 INFO:teuthology.orchestra.run.smithi135.stderr: 13450K .......... .......... .......... .......... .......... 18% 251M 0s 2019-11-25T09:39:52.791 INFO:teuthology.orchestra.run.smithi135.stderr: 13500K .......... .......... .......... .......... .......... 18% 246M 0s 2019-11-25T09:39:52.792 INFO:teuthology.orchestra.run.smithi135.stderr: 13550K .......... .......... .......... .......... .......... 18% 212M 0s 2019-11-25T09:39:52.792 INFO:teuthology.orchestra.run.smithi135.stderr: 13600K .......... .......... .......... .......... .......... 18% 231M 0s 2019-11-25T09:39:52.792 INFO:teuthology.orchestra.run.smithi135.stderr: 13650K .......... .......... .......... .......... .......... 18% 251M 0s 2019-11-25T09:39:52.792 INFO:teuthology.orchestra.run.smithi135.stderr: 13700K .......... .......... .......... .......... .......... 18% 247M 0s 2019-11-25T09:39:52.792 INFO:teuthology.orchestra.run.smithi135.stderr: 13750K .......... .......... .......... .......... .......... 18% 207M 0s 2019-11-25T09:39:52.792 INFO:teuthology.orchestra.run.smithi135.stderr: 13800K .......... .......... .......... .......... .......... 18% 238M 0s 2019-11-25T09:39:52.792 INFO:teuthology.orchestra.run.smithi135.stderr: 13850K .......... .......... .......... .......... .......... 18% 243M 0s 2019-11-25T09:39:52.793 INFO:teuthology.orchestra.run.smithi135.stderr: 13900K .......... .......... .......... .......... .......... 18% 244M 0s 2019-11-25T09:39:52.793 INFO:teuthology.orchestra.run.smithi135.stderr: 13950K .......... .......... .......... .......... .......... 19% 207M 0s 2019-11-25T09:39:52.793 INFO:teuthology.orchestra.run.smithi135.stderr: 14000K .......... .......... .......... .......... .......... 19% 259M 0s 2019-11-25T09:39:52.793 INFO:teuthology.orchestra.run.smithi135.stderr: 14050K .......... .......... .......... .......... .......... 19% 219M 0s 2019-11-25T09:39:52.793 INFO:teuthology.orchestra.run.smithi135.stderr: 14100K .......... .......... .......... .......... .......... 19% 249M 0s 2019-11-25T09:39:52.793 INFO:teuthology.orchestra.run.smithi135.stderr: 14150K .......... .......... .......... .......... .......... 19% 208M 0s 2019-11-25T09:39:52.793 INFO:teuthology.orchestra.run.smithi135.stderr: 14200K .......... .......... .......... .......... .......... 19% 265M 0s 2019-11-25T09:39:52.794 INFO:teuthology.orchestra.run.smithi135.stderr: 14250K .......... .......... .......... .......... .......... 19% 278M 0s 2019-11-25T09:39:52.794 INFO:teuthology.orchestra.run.smithi135.stderr: 14300K .......... .......... .......... .......... .......... 19% 254M 0s 2019-11-25T09:39:52.794 INFO:teuthology.orchestra.run.smithi135.stderr: 14350K .......... .......... .......... .......... .......... 19% 240M 0s 2019-11-25T09:39:52.794 INFO:teuthology.orchestra.run.smithi135.stderr: 14400K .......... .......... .......... .......... .......... 19% 262M 0s 2019-11-25T09:39:52.794 INFO:teuthology.orchestra.run.smithi135.stderr: 14450K .......... .......... .......... .......... .......... 19% 266M 0s 2019-11-25T09:39:52.794 INFO:teuthology.orchestra.run.smithi135.stderr: 14500K .......... .......... .......... .......... .......... 19% 278M 0s 2019-11-25T09:39:52.794 INFO:teuthology.orchestra.run.smithi135.stderr: 14550K .......... .......... .......... .......... .......... 19% 224M 0s 2019-11-25T09:39:52.794 INFO:teuthology.orchestra.run.smithi135.stderr: 14600K .......... .......... .......... .......... .......... 19% 243M 0s 2019-11-25T09:39:52.795 INFO:teuthology.orchestra.run.smithi135.stderr: 14650K .......... .......... .......... .......... .......... 19% 238M 0s 2019-11-25T09:39:52.795 INFO:teuthology.orchestra.run.smithi135.stderr: 14700K .......... .......... .......... .......... .......... 20% 255M 0s 2019-11-25T09:39:52.795 INFO:teuthology.orchestra.run.smithi135.stderr: 14750K .......... .......... .......... .......... .......... 20% 247M 0s 2019-11-25T09:39:52.795 INFO:teuthology.orchestra.run.smithi135.stderr: 14800K .......... .......... .......... .......... .......... 20% 271M 0s 2019-11-25T09:39:52.795 INFO:teuthology.orchestra.run.smithi135.stderr: 14850K .......... .......... .......... .......... .......... 20% 268M 0s 2019-11-25T09:39:52.795 INFO:teuthology.orchestra.run.smithi135.stderr: 14900K .......... .......... .......... .......... .......... 20% 269M 0s 2019-11-25T09:39:52.795 INFO:teuthology.orchestra.run.smithi135.stderr: 14950K .......... .......... .......... .......... .......... 20% 220M 0s 2019-11-25T09:39:52.796 INFO:teuthology.orchestra.run.smithi135.stderr: 15000K .......... .......... .......... .......... .......... 20% 207M 0s 2019-11-25T09:39:52.796 INFO:teuthology.orchestra.run.smithi135.stderr: 15050K .......... .......... .......... .......... .......... 20% 190M 0s 2019-11-25T09:39:52.796 INFO:teuthology.orchestra.run.smithi135.stderr: 15100K .......... .......... .......... .......... .......... 20% 250M 0s 2019-11-25T09:39:52.796 INFO:teuthology.orchestra.run.smithi135.stderr: 15150K .......... .......... .......... .......... .......... 20% 230M 0s 2019-11-25T09:39:52.796 INFO:teuthology.orchestra.run.smithi135.stderr: 15200K .......... .......... .......... .......... .......... 20% 257M 0s 2019-11-25T09:39:52.796 INFO:teuthology.orchestra.run.smithi135.stderr: 15250K .......... .......... .......... .......... .......... 20% 269M 0s 2019-11-25T09:39:52.796 INFO:teuthology.orchestra.run.smithi135.stderr: 15300K .......... .......... .......... .......... .......... 20% 252M 0s 2019-11-25T09:39:52.797 INFO:teuthology.orchestra.run.smithi135.stderr: 15350K .......... .......... .......... .......... .......... 20% 220M 0s 2019-11-25T09:39:52.797 INFO:teuthology.orchestra.run.smithi135.stderr: 15400K .......... .......... .......... .......... .......... 21% 270M 0s 2019-11-25T09:39:52.797 INFO:teuthology.orchestra.run.smithi135.stderr: 15450K .......... .......... .......... .......... .......... 21% 244M 0s 2019-11-25T09:39:52.797 INFO:teuthology.orchestra.run.smithi135.stderr: 15500K .......... .......... .......... .......... .......... 21% 247M 0s 2019-11-25T09:39:52.797 INFO:teuthology.orchestra.run.smithi135.stderr: 15550K .......... .......... .......... .......... .......... 21% 229M 0s 2019-11-25T09:39:52.797 INFO:teuthology.orchestra.run.smithi135.stderr: 15600K .......... .......... .......... .......... .......... 21% 270M 0s 2019-11-25T09:39:52.798 INFO:teuthology.orchestra.run.smithi135.stderr: 15650K .......... .......... .......... .......... .......... 21% 265M 0s 2019-11-25T09:39:52.798 INFO:teuthology.orchestra.run.smithi135.stderr: 15700K .......... .......... .......... .......... .......... 21% 268M 0s 2019-11-25T09:39:52.798 INFO:teuthology.orchestra.run.smithi135.stderr: 15750K .......... .......... .......... .......... .......... 21% 229M 0s 2019-11-25T09:39:52.798 INFO:teuthology.orchestra.run.smithi135.stderr: 15800K .......... .......... .......... .......... .......... 21% 266M 0s 2019-11-25T09:39:52.798 INFO:teuthology.orchestra.run.smithi135.stderr: 15850K .......... .......... .......... .......... .......... 21% 256M 0s 2019-11-25T09:39:52.798 INFO:teuthology.orchestra.run.smithi135.stderr: 15900K .......... .......... .......... .......... .......... 21% 283M 0s 2019-11-25T09:39:52.798 INFO:teuthology.orchestra.run.smithi135.stderr: 15950K .......... .......... .......... .......... .......... 21% 236M 0s 2019-11-25T09:39:52.798 INFO:teuthology.orchestra.run.smithi135.stderr: 16000K .......... .......... .......... .......... .......... 21% 277M 0s 2019-11-25T09:39:52.799 INFO:teuthology.orchestra.run.smithi135.stderr: 16050K .......... .......... .......... .......... .......... 21% 276M 0s 2019-11-25T09:39:52.799 INFO:teuthology.orchestra.run.smithi135.stderr: 16100K .......... .......... .......... .......... .......... 21% 248M 0s 2019-11-25T09:39:52.799 INFO:teuthology.orchestra.run.smithi135.stderr: 16150K .......... .......... .......... .......... .......... 22% 214M 0s 2019-11-25T09:39:52.799 INFO:teuthology.orchestra.run.smithi135.stderr: 16200K .......... .......... .......... .......... .......... 22% 221M 0s 2019-11-25T09:39:52.799 INFO:teuthology.orchestra.run.smithi135.stderr: 16250K .......... .......... .......... .......... .......... 22% 228M 0s 2019-11-25T09:39:52.799 INFO:teuthology.orchestra.run.smithi135.stderr: 16300K .......... .......... .......... .......... .......... 22% 272M 0s 2019-11-25T09:39:52.799 INFO:teuthology.orchestra.run.smithi135.stderr: 16350K .......... .......... .......... .......... .......... 22% 208M 0s 2019-11-25T09:39:52.800 INFO:teuthology.orchestra.run.smithi135.stderr: 16400K .......... .......... .......... .......... .......... 22% 238M 0s 2019-11-25T09:39:52.800 INFO:teuthology.orchestra.run.smithi135.stderr: 16450K .......... .......... .......... .......... .......... 22% 230M 0s 2019-11-25T09:39:52.800 INFO:teuthology.orchestra.run.smithi135.stderr: 16500K .......... .......... .......... .......... .......... 22% 254M 0s 2019-11-25T09:39:52.800 INFO:teuthology.orchestra.run.smithi135.stderr: 16550K .......... .......... .......... .......... .......... 22% 182M 0s 2019-11-25T09:39:52.800 INFO:teuthology.orchestra.run.smithi135.stderr: 16600K .......... .......... .......... .......... .......... 22% 264M 0s 2019-11-25T09:39:52.800 INFO:teuthology.orchestra.run.smithi135.stderr: 16650K .......... .......... .......... .......... .......... 22% 291M 0s 2019-11-25T09:39:52.800 INFO:teuthology.orchestra.run.smithi135.stderr: 16700K .......... .......... .......... .......... .......... 22% 275M 0s 2019-11-25T09:39:52.801 INFO:teuthology.orchestra.run.smithi135.stderr: 16750K .......... .......... .......... .......... .......... 22% 229M 0s 2019-11-25T09:39:52.801 INFO:teuthology.orchestra.run.smithi135.stderr: 16800K .......... .......... .......... .......... .......... 22% 263M 0s 2019-11-25T09:39:52.801 INFO:teuthology.orchestra.run.smithi135.stderr: 16850K .......... .......... .......... .......... .......... 22% 261M 0s 2019-11-25T09:39:52.801 INFO:teuthology.orchestra.run.smithi135.stderr: 16900K .......... .......... .......... .......... .......... 23% 254M 0s 2019-11-25T09:39:52.801 INFO:teuthology.orchestra.run.smithi135.stderr: 16950K .......... .......... .......... .......... .......... 23% 221M 0s 2019-11-25T09:39:52.801 INFO:teuthology.orchestra.run.smithi135.stderr: 17000K .......... .......... .......... .......... .......... 23% 278M 0s 2019-11-25T09:39:52.801 INFO:teuthology.orchestra.run.smithi135.stderr: 17050K .......... .......... .......... .......... .......... 23% 256M 0s 2019-11-25T09:39:52.802 INFO:teuthology.orchestra.run.smithi135.stderr: 17100K .......... .......... .......... .......... .......... 23% 264M 0s 2019-11-25T09:39:52.802 INFO:teuthology.orchestra.run.smithi135.stderr: 17150K .......... .......... .......... .......... .......... 23% 251M 0s 2019-11-25T09:39:52.802 INFO:teuthology.orchestra.run.smithi135.stderr: 17200K .......... .......... .......... .......... .......... 23% 271M 0s 2019-11-25T09:39:52.802 INFO:teuthology.orchestra.run.smithi135.stderr: 17250K .......... .......... .......... .......... .......... 23% 259M 0s 2019-11-25T09:39:52.802 INFO:teuthology.orchestra.run.smithi135.stderr: 17300K .......... .......... .......... .......... .......... 23% 269M 0s 2019-11-25T09:39:52.802 INFO:teuthology.orchestra.run.smithi135.stderr: 17350K .......... .......... .......... .......... .......... 23% 215M 0s 2019-11-25T09:39:52.802 INFO:teuthology.orchestra.run.smithi135.stderr: 17400K .......... .......... .......... .......... .......... 23% 264M 0s 2019-11-25T09:39:52.803 INFO:teuthology.orchestra.run.smithi135.stderr: 17450K .......... .......... .......... .......... .......... 23% 272M 0s 2019-11-25T09:39:52.803 INFO:teuthology.orchestra.run.smithi135.stderr: 17500K .......... .......... .......... .......... .......... 23% 288M 0s 2019-11-25T09:39:52.803 INFO:teuthology.orchestra.run.smithi135.stderr: 17550K .......... .......... .......... .......... .......... 23% 246M 0s 2019-11-25T09:39:52.803 INFO:teuthology.orchestra.run.smithi135.stderr: 17600K .......... .......... .......... .......... .......... 23% 275M 0s 2019-11-25T09:39:52.803 INFO:teuthology.orchestra.run.smithi135.stderr: 17650K .......... .......... .......... .......... .......... 24% 284M 0s 2019-11-25T09:39:52.803 INFO:teuthology.orchestra.run.smithi135.stderr: 17700K .......... .......... .......... .......... .......... 24% 294M 0s 2019-11-25T09:39:52.803 INFO:teuthology.orchestra.run.smithi135.stderr: 17750K .......... .......... .......... .......... .......... 24% 231M 0s 2019-11-25T09:39:52.803 INFO:teuthology.orchestra.run.smithi135.stderr: 17800K .......... .......... .......... .......... .......... 24% 276M 0s 2019-11-25T09:39:52.804 INFO:teuthology.orchestra.run.smithi135.stderr: 17850K .......... .......... .......... .......... .......... 24% 286M 0s 2019-11-25T09:39:52.804 INFO:teuthology.orchestra.run.smithi135.stderr: 17900K .......... .......... .......... .......... .......... 24% 274M 0s 2019-11-25T09:39:52.804 INFO:teuthology.orchestra.run.smithi135.stderr: 17950K .......... .......... .......... .......... .......... 24% 231M 0s 2019-11-25T09:39:52.804 INFO:teuthology.orchestra.run.smithi135.stderr: 18000K .......... .......... .......... .......... .......... 24% 282M 0s 2019-11-25T09:39:52.804 INFO:teuthology.orchestra.run.smithi135.stderr: 18050K .......... .......... .......... .......... .......... 24% 281M 0s 2019-11-25T09:39:52.804 INFO:teuthology.orchestra.run.smithi135.stderr: 18100K .......... .......... .......... .......... .......... 24% 280M 0s 2019-11-25T09:39:52.804 INFO:teuthology.orchestra.run.smithi135.stderr: 18150K .......... .......... .......... .......... .......... 24% 245M 0s 2019-11-25T09:39:52.805 INFO:teuthology.orchestra.run.smithi135.stderr: 18200K .......... .......... .......... .......... .......... 24% 289M 0s 2019-11-25T09:39:52.805 INFO:teuthology.orchestra.run.smithi135.stderr: 18250K .......... .......... .......... .......... .......... 24% 276M 0s 2019-11-25T09:39:52.805 INFO:teuthology.orchestra.run.smithi135.stderr: 18300K .......... .......... .......... .......... .......... 24% 275M 0s 2019-11-25T09:39:52.805 INFO:teuthology.orchestra.run.smithi135.stderr: 18350K .......... .......... .......... .......... .......... 25% 226M 0s 2019-11-25T09:39:52.805 INFO:teuthology.orchestra.run.smithi135.stderr: 18400K .......... .......... .......... .......... .......... 25% 274M 0s 2019-11-25T09:39:52.805 INFO:teuthology.orchestra.run.smithi135.stderr: 18450K .......... .......... .......... .......... .......... 25% 253M 0s 2019-11-25T09:39:52.805 INFO:teuthology.orchestra.run.smithi135.stderr: 18500K .......... .......... .......... .......... .......... 25% 272M 0s 2019-11-25T09:39:52.806 INFO:teuthology.orchestra.run.smithi135.stderr: 18550K .......... .......... .......... .......... .......... 25% 243M 0s 2019-11-25T09:39:52.806 INFO:teuthology.orchestra.run.smithi135.stderr: 18600K .......... .......... .......... .......... .......... 25% 259M 0s 2019-11-25T09:39:52.806 INFO:teuthology.orchestra.run.smithi135.stderr: 18650K .......... .......... .......... .......... .......... 25% 269M 0s 2019-11-25T09:39:52.806 INFO:teuthology.orchestra.run.smithi135.stderr: 18700K .......... .......... .......... .......... .......... 25% 272M 0s 2019-11-25T09:39:52.806 INFO:teuthology.orchestra.run.smithi135.stderr: 18750K .......... .......... .......... .......... .......... 25% 218M 0s 2019-11-25T09:39:52.806 INFO:teuthology.orchestra.run.smithi135.stderr: 18800K .......... .......... .......... .......... .......... 25% 270M 0s 2019-11-25T09:39:52.806 INFO:teuthology.orchestra.run.smithi135.stderr: 18850K .......... .......... .......... .......... .......... 25% 259M 0s 2019-11-25T09:39:52.807 INFO:teuthology.orchestra.run.smithi135.stderr: 18900K .......... .......... .......... .......... .......... 25% 259M 0s 2019-11-25T09:39:52.807 INFO:teuthology.orchestra.run.smithi135.stderr: 18950K .......... .......... .......... .......... .......... 25% 230M 0s 2019-11-25T09:39:52.807 INFO:teuthology.orchestra.run.smithi135.stderr: 19000K .......... .......... .......... .......... .......... 25% 265M 0s 2019-11-25T09:39:52.807 INFO:teuthology.orchestra.run.smithi135.stderr: 19050K .......... .......... .......... .......... .......... 25% 295M 0s 2019-11-25T09:39:52.807 INFO:teuthology.orchestra.run.smithi135.stderr: 19100K .......... .......... .......... .......... .......... 26% 295M 0s 2019-11-25T09:39:52.807 INFO:teuthology.orchestra.run.smithi135.stderr: 19150K .......... .......... .......... .......... .......... 26% 270M 0s 2019-11-25T09:39:52.807 INFO:teuthology.orchestra.run.smithi135.stderr: 19200K .......... .......... .......... .......... .......... 26% 303M 0s 2019-11-25T09:39:52.807 INFO:teuthology.orchestra.run.smithi135.stderr: 19250K .......... .......... .......... .......... .......... 26% 280M 0s 2019-11-25T09:39:52.808 INFO:teuthology.orchestra.run.smithi135.stderr: 19300K .......... .......... .......... .......... .......... 26% 297M 0s 2019-11-25T09:39:52.808 INFO:teuthology.orchestra.run.smithi135.stderr: 19350K .......... .......... .......... .......... .......... 26% 255M 0s 2019-11-25T09:39:52.808 INFO:teuthology.orchestra.run.smithi135.stderr: 19400K .......... .......... .......... .......... .......... 26% 299M 0s 2019-11-25T09:39:52.808 INFO:teuthology.orchestra.run.smithi135.stderr: 19450K .......... .......... .......... .......... .......... 26% 194M 0s 2019-11-25T09:39:52.808 INFO:teuthology.orchestra.run.smithi135.stderr: 19500K .......... .......... .......... .......... .......... 26% 226M 0s 2019-11-25T09:39:52.808 INFO:teuthology.orchestra.run.smithi135.stderr: 19550K .......... .......... .......... .......... .......... 26% 205M 0s 2019-11-25T09:39:52.808 INFO:teuthology.orchestra.run.smithi135.stderr: 19600K .......... .......... .......... .......... .......... 26% 249M 0s 2019-11-25T09:39:52.809 INFO:teuthology.orchestra.run.smithi135.stderr: 19650K .......... .......... .......... .......... .......... 26% 293M 0s 2019-11-25T09:39:52.809 INFO:teuthology.orchestra.run.smithi135.stderr: 19700K .......... .......... .......... .......... .......... 26% 290M 0s 2019-11-25T09:39:52.809 INFO:teuthology.orchestra.run.smithi135.stderr: 19750K .......... .......... .......... .......... .......... 26% 237M 0s 2019-11-25T09:39:52.809 INFO:teuthology.orchestra.run.smithi135.stderr: 19800K .......... .......... .......... .......... .......... 26% 286M 0s 2019-11-25T09:39:52.809 INFO:teuthology.orchestra.run.smithi135.stderr: 19850K .......... .......... .......... .......... .......... 27% 292M 0s 2019-11-25T09:39:52.809 INFO:teuthology.orchestra.run.smithi135.stderr: 19900K .......... .......... .......... .......... .......... 27% 277M 0s 2019-11-25T09:39:52.809 INFO:teuthology.orchestra.run.smithi135.stderr: 19950K .......... .......... .......... .......... .......... 27% 243M 0s 2019-11-25T09:39:52.810 INFO:teuthology.orchestra.run.smithi135.stderr: 20000K .......... .......... .......... .......... .......... 27% 283M 0s 2019-11-25T09:39:52.810 INFO:teuthology.orchestra.run.smithi135.stderr: 20050K .......... .......... .......... .......... .......... 27% 283M 0s 2019-11-25T09:39:52.810 INFO:teuthology.orchestra.run.smithi135.stderr: 20100K .......... .......... .......... .......... .......... 27% 269M 0s 2019-11-25T09:39:52.810 INFO:teuthology.orchestra.run.smithi135.stderr: 20150K .......... .......... .......... .......... .......... 27% 215M 0s 2019-11-25T09:39:52.810 INFO:teuthology.orchestra.run.smithi135.stderr: 20200K .......... .......... .......... .......... .......... 27% 266M 0s 2019-11-25T09:39:52.810 INFO:teuthology.orchestra.run.smithi135.stderr: 20250K .......... .......... .......... .......... .......... 27% 253M 0s 2019-11-25T09:39:52.810 INFO:teuthology.orchestra.run.smithi135.stderr: 20300K .......... .......... .......... .......... .......... 27% 232M 0s 2019-11-25T09:39:52.810 INFO:teuthology.orchestra.run.smithi135.stderr: 20350K .......... .......... .......... .......... .......... 27% 237M 0s 2019-11-25T09:39:52.811 INFO:teuthology.orchestra.run.smithi135.stderr: 20400K .......... .......... .......... .......... .......... 27% 271M 0s 2019-11-25T09:39:52.811 INFO:teuthology.orchestra.run.smithi135.stderr: 20450K .......... .......... .......... .......... .......... 27% 273M 0s 2019-11-25T09:39:52.811 INFO:teuthology.orchestra.run.smithi135.stderr: 20500K .......... .......... .......... .......... .......... 27% 275M 0s 2019-11-25T09:39:52.811 INFO:teuthology.orchestra.run.smithi135.stderr: 20550K .......... .......... .......... .......... .......... 28% 169M 0s 2019-11-25T09:39:52.811 INFO:teuthology.orchestra.run.smithi135.stderr: 20600K .......... .......... .......... .......... .......... 28% 251M 0s 2019-11-25T09:39:52.811 INFO:teuthology.orchestra.run.smithi135.stderr: 20650K .......... .......... .......... .......... .......... 28% 291M 0s 2019-11-25T09:39:52.811 INFO:teuthology.orchestra.run.smithi135.stderr: 20700K .......... .......... .......... .......... .......... 28% 258M 0s 2019-11-25T09:39:52.812 INFO:teuthology.orchestra.run.smithi135.stderr: 20750K .......... .......... .......... .......... .......... 28% 245M 0s 2019-11-25T09:39:52.812 INFO:teuthology.orchestra.run.smithi135.stderr: 20800K .......... .......... .......... .......... .......... 28% 257M 0s 2019-11-25T09:39:52.812 INFO:teuthology.orchestra.run.smithi135.stderr: 20850K .......... .......... .......... .......... .......... 28% 280M 0s 2019-11-25T09:39:52.812 INFO:teuthology.orchestra.run.smithi135.stderr: 20900K .......... .......... .......... .......... .......... 28% 306M 0s 2019-11-25T09:39:52.812 INFO:teuthology.orchestra.run.smithi135.stderr: 20950K .......... .......... .......... .......... .......... 28% 260M 0s 2019-11-25T09:39:52.812 INFO:teuthology.orchestra.run.smithi135.stderr: 21000K .......... .......... .......... .......... .......... 28% 292M 0s 2019-11-25T09:39:52.812 INFO:teuthology.orchestra.run.smithi135.stderr: 21050K .......... .......... .......... .......... .......... 28% 228M 0s 2019-11-25T09:39:52.813 INFO:teuthology.orchestra.run.smithi135.stderr: 21100K .......... .......... .......... .......... .......... 28% 225M 0s 2019-11-25T09:39:52.813 INFO:teuthology.orchestra.run.smithi135.stderr: 21150K .......... .......... .......... .......... .......... 28% 253M 0s 2019-11-25T09:39:52.813 INFO:teuthology.orchestra.run.smithi135.stderr: 21200K .......... .......... .......... .......... .......... 28% 251M 0s 2019-11-25T09:39:52.813 INFO:teuthology.orchestra.run.smithi135.stderr: 21250K .......... .......... .......... .......... .......... 28% 234M 0s 2019-11-25T09:39:52.813 INFO:teuthology.orchestra.run.smithi135.stderr: 21300K .......... .......... .......... .......... .......... 29% 310M 0s 2019-11-25T09:39:52.813 INFO:teuthology.orchestra.run.smithi135.stderr: 21350K .......... .......... .......... .......... .......... 29% 186M 0s 2019-11-25T09:39:52.813 INFO:teuthology.orchestra.run.smithi135.stderr: 21400K .......... .......... .......... .......... .......... 29% 234M 0s 2019-11-25T09:39:52.814 INFO:teuthology.orchestra.run.smithi135.stderr: 21450K .......... .......... .......... .......... .......... 29% 290M 0s 2019-11-25T09:39:52.814 INFO:teuthology.orchestra.run.smithi135.stderr: 21500K .......... .......... .......... .......... .......... 29% 298M 0s 2019-11-25T09:39:52.814 INFO:teuthology.orchestra.run.smithi135.stderr: 21550K .......... .......... .......... .......... .......... 29% 217M 0s 2019-11-25T09:39:52.814 INFO:teuthology.orchestra.run.smithi135.stderr: 21600K .......... .......... .......... .......... .......... 29% 282M 0s 2019-11-25T09:39:52.814 INFO:teuthology.orchestra.run.smithi135.stderr: 21650K .......... .......... .......... .......... .......... 29% 271M 0s 2019-11-25T09:39:52.814 INFO:teuthology.orchestra.run.smithi135.stderr: 21700K .......... .......... .......... .......... .......... 29% 297M 0s 2019-11-25T09:39:52.814 INFO:teuthology.orchestra.run.smithi135.stderr: 21750K .......... .......... .......... .......... .......... 29% 250M 0s 2019-11-25T09:39:52.815 INFO:teuthology.orchestra.run.smithi135.stderr: 21800K .......... .......... .......... .......... .......... 29% 308M 0s 2019-11-25T09:39:52.815 INFO:teuthology.orchestra.run.smithi135.stderr: 21850K .......... .......... .......... .......... .......... 29% 291M 0s 2019-11-25T09:39:52.815 INFO:teuthology.orchestra.run.smithi135.stderr: 21900K .......... .......... .......... .......... .......... 29% 301M 0s 2019-11-25T09:39:52.815 INFO:teuthology.orchestra.run.smithi135.stderr: 21950K .......... .......... .......... .......... .......... 29% 280M 0s 2019-11-25T09:39:52.815 INFO:teuthology.orchestra.run.smithi135.stderr: 22000K .......... .......... .......... .......... .......... 29% 304M 0s 2019-11-25T09:39:52.815 INFO:teuthology.orchestra.run.smithi135.stderr: 22050K .......... .......... .......... .......... .......... 30% 281M 0s 2019-11-25T09:39:52.815 INFO:teuthology.orchestra.run.smithi135.stderr: 22100K .......... .......... .......... .......... .......... 30% 278M 0s 2019-11-25T09:39:52.815 INFO:teuthology.orchestra.run.smithi135.stderr: 22150K .......... .......... .......... .......... .......... 30% 237M 0s 2019-11-25T09:39:52.816 INFO:teuthology.orchestra.run.smithi135.stderr: 22200K .......... .......... .......... .......... .......... 30% 270M 0s 2019-11-25T09:39:52.816 INFO:teuthology.orchestra.run.smithi135.stderr: 22250K .......... .......... .......... .......... .......... 30% 314M 0s 2019-11-25T09:39:52.816 INFO:teuthology.orchestra.run.smithi135.stderr: 22300K .......... .......... .......... .......... .......... 30% 297M 0s 2019-11-25T09:39:52.816 INFO:teuthology.orchestra.run.smithi135.stderr: 22350K .......... .......... .......... .......... .......... 30% 228M 0s 2019-11-25T09:39:52.816 INFO:teuthology.orchestra.run.smithi135.stderr: 22400K .......... .......... .......... .......... .......... 30% 313M 0s 2019-11-25T09:39:52.816 INFO:teuthology.orchestra.run.smithi135.stderr: 22450K .......... .......... .......... .......... .......... 30% 307M 0s 2019-11-25T09:39:52.816 INFO:teuthology.orchestra.run.smithi135.stderr: 22500K .......... .......... .......... .......... .......... 30% 313M 0s 2019-11-25T09:39:52.817 INFO:teuthology.orchestra.run.smithi135.stderr: 22550K .......... .......... .......... .......... .......... 30% 278M 0s 2019-11-25T09:39:52.817 INFO:teuthology.orchestra.run.smithi135.stderr: 22600K .......... .......... .......... .......... .......... 30% 308M 0s 2019-11-25T09:39:52.817 INFO:teuthology.orchestra.run.smithi135.stderr: 22650K .......... .......... .......... .......... .......... 30% 311M 0s 2019-11-25T09:39:52.817 INFO:teuthology.orchestra.run.smithi135.stderr: 22700K .......... .......... .......... .......... .......... 30% 295M 0s 2019-11-25T09:39:52.817 INFO:teuthology.orchestra.run.smithi135.stderr: 22750K .......... .......... .......... .......... .......... 30% 245M 0s 2019-11-25T09:39:52.817 INFO:teuthology.orchestra.run.smithi135.stderr: 22800K .......... .......... .......... .......... .......... 31% 288M 0s 2019-11-25T09:39:52.818 INFO:teuthology.orchestra.run.smithi135.stderr: 22850K .......... .......... .......... .......... .......... 31% 284M 0s 2019-11-25T09:39:52.818 INFO:teuthology.orchestra.run.smithi135.stderr: 22900K .......... .......... .......... .......... .......... 31% 302M 0s 2019-11-25T09:39:52.818 INFO:teuthology.orchestra.run.smithi135.stderr: 22950K .......... .......... .......... .......... .......... 31% 262M 0s 2019-11-25T09:39:52.818 INFO:teuthology.orchestra.run.smithi135.stderr: 23000K .......... .......... .......... .......... .......... 31% 301M 0s 2019-11-25T09:39:52.818 INFO:teuthology.orchestra.run.smithi135.stderr: 23050K .......... .......... .......... .......... .......... 31% 277M 0s 2019-11-25T09:39:52.818 INFO:teuthology.orchestra.run.smithi135.stderr: 23100K .......... .......... .......... .......... .......... 31% 290M 0s 2019-11-25T09:39:52.818 INFO:teuthology.orchestra.run.smithi135.stderr: 23150K .......... .......... .......... .......... .......... 31% 215M 0s 2019-11-25T09:39:52.819 INFO:teuthology.orchestra.run.smithi135.stderr: 23200K .......... .......... .......... .......... .......... 31% 283M 0s 2019-11-25T09:39:52.819 INFO:teuthology.orchestra.run.smithi135.stderr: 23250K .......... .......... .......... .......... .......... 31% 309M 0s 2019-11-25T09:39:52.819 INFO:teuthology.orchestra.run.smithi135.stderr: 23300K .......... .......... .......... .......... .......... 31% 309M 0s 2019-11-25T09:39:52.819 INFO:teuthology.orchestra.run.smithi135.stderr: 23350K .......... .......... .......... .......... .......... 31% 261M 0s 2019-11-25T09:39:52.819 INFO:teuthology.orchestra.run.smithi135.stderr: 23400K .......... .......... .......... .......... .......... 31% 308M 0s 2019-11-25T09:39:52.819 INFO:teuthology.orchestra.run.smithi135.stderr: 23450K .......... .......... .......... .......... .......... 31% 311M 0s 2019-11-25T09:39:52.819 INFO:teuthology.orchestra.run.smithi135.stderr: 23500K .......... .......... .......... .......... .......... 32% 295M 0s 2019-11-25T09:39:52.820 INFO:teuthology.orchestra.run.smithi135.stderr: 23550K .......... .......... .......... .......... .......... 32% 240M 0s 2019-11-25T09:39:52.820 INFO:teuthology.orchestra.run.smithi135.stderr: 23600K .......... .......... .......... .......... .......... 32% 282M 0s 2019-11-25T09:39:52.820 INFO:teuthology.orchestra.run.smithi135.stderr: 23650K .......... .......... .......... .......... .......... 32% 284M 0s 2019-11-25T09:39:52.820 INFO:teuthology.orchestra.run.smithi135.stderr: 23700K .......... .......... .......... .......... .......... 32% 272M 0s 2019-11-25T09:39:52.820 INFO:teuthology.orchestra.run.smithi135.stderr: 23750K .......... .......... .......... .......... .......... 32% 245M 0s 2019-11-25T09:39:52.820 INFO:teuthology.orchestra.run.smithi135.stderr: 23800K .......... .......... .......... .......... .......... 32% 278M 0s 2019-11-25T09:39:52.820 INFO:teuthology.orchestra.run.smithi135.stderr: 23850K .......... .......... .......... .......... .......... 32% 261M 0s 2019-11-25T09:39:52.821 INFO:teuthology.orchestra.run.smithi135.stderr: 23900K .......... .......... .......... .......... .......... 32% 231M 0s 2019-11-25T09:39:52.821 INFO:teuthology.orchestra.run.smithi135.stderr: 23950K .......... .......... .......... .......... .......... 32% 215M 0s 2019-11-25T09:39:52.821 INFO:teuthology.orchestra.run.smithi135.stderr: 24000K .......... .......... .......... .......... .......... 32% 269M 0s 2019-11-25T09:39:52.821 INFO:teuthology.orchestra.run.smithi135.stderr: 24050K .......... .......... .......... .......... .......... 32% 265M 0s 2019-11-25T09:39:52.821 INFO:teuthology.orchestra.run.smithi135.stderr: 24100K .......... .......... .......... .......... .......... 32% 283M 0s 2019-11-25T09:39:52.821 INFO:teuthology.orchestra.run.smithi135.stderr: 24150K .......... .......... .......... .......... .......... 32% 227M 0s 2019-11-25T09:39:52.821 INFO:teuthology.orchestra.run.smithi135.stderr: 24200K .......... .......... .......... .......... .......... 32% 262M 0s 2019-11-25T09:39:52.822 INFO:teuthology.orchestra.run.smithi135.stderr: 24250K .......... .......... .......... .......... .......... 33% 263M 0s 2019-11-25T09:39:52.822 INFO:teuthology.orchestra.run.smithi135.stderr: 24300K .......... .......... .......... .......... .......... 33% 288M 0s 2019-11-25T09:39:52.822 INFO:teuthology.orchestra.run.smithi135.stderr: 24350K .......... .......... .......... .......... .......... 33% 208M 0s 2019-11-25T09:39:52.822 INFO:teuthology.orchestra.run.smithi135.stderr: 24400K .......... .......... .......... .......... .......... 33% 269M 0s 2019-11-25T09:39:52.822 INFO:teuthology.orchestra.run.smithi135.stderr: 24450K .......... .......... .......... .......... .......... 33% 307M 0s 2019-11-25T09:39:52.822 INFO:teuthology.orchestra.run.smithi135.stderr: 24500K .......... .......... .......... .......... .......... 33% 256M 0s 2019-11-25T09:39:52.822 INFO:teuthology.orchestra.run.smithi135.stderr: 24550K .......... .......... .......... .......... .......... 33% 275M 0s 2019-11-25T09:39:52.823 INFO:teuthology.orchestra.run.smithi135.stderr: 24600K .......... .......... .......... .......... .......... 33% 327M 0s 2019-11-25T09:39:52.823 INFO:teuthology.orchestra.run.smithi135.stderr: 24650K .......... .......... .......... .......... .......... 33% 271M 0s 2019-11-25T09:39:52.823 INFO:teuthology.orchestra.run.smithi135.stderr: 24700K .......... .......... .......... .......... .......... 33% 216M 0s 2019-11-25T09:39:52.823 INFO:teuthology.orchestra.run.smithi135.stderr: 24750K .......... .......... .......... .......... .......... 33% 214M 0s 2019-11-25T09:39:52.823 INFO:teuthology.orchestra.run.smithi135.stderr: 24800K .......... .......... .......... .......... .......... 33% 293M 0s 2019-11-25T09:39:52.823 INFO:teuthology.orchestra.run.smithi135.stderr: 24850K .......... .......... .......... .......... .......... 33% 318M 0s 2019-11-25T09:39:52.823 INFO:teuthology.orchestra.run.smithi135.stderr: 24900K .......... .......... .......... .......... .......... 33% 318M 0s 2019-11-25T09:39:52.824 INFO:teuthology.orchestra.run.smithi135.stderr: 24950K .......... .......... .......... .......... .......... 33% 271M 0s 2019-11-25T09:39:52.824 INFO:teuthology.orchestra.run.smithi135.stderr: 25000K .......... .......... .......... .......... .......... 34% 319M 0s 2019-11-25T09:39:52.824 INFO:teuthology.orchestra.run.smithi135.stderr: 25050K .......... .......... .......... .......... .......... 34% 311M 0s 2019-11-25T09:39:52.824 INFO:teuthology.orchestra.run.smithi135.stderr: 25100K .......... .......... .......... .......... .......... 34% 313M 0s 2019-11-25T09:39:52.824 INFO:teuthology.orchestra.run.smithi135.stderr: 25150K .......... .......... .......... .......... .......... 34% 265M 0s 2019-11-25T09:39:52.824 INFO:teuthology.orchestra.run.smithi135.stderr: 25200K .......... .......... .......... .......... .......... 34% 328M 0s 2019-11-25T09:39:52.824 INFO:teuthology.orchestra.run.smithi135.stderr: 25250K .......... .......... .......... .......... .......... 34% 322M 0s 2019-11-25T09:39:52.825 INFO:teuthology.orchestra.run.smithi135.stderr: 25300K .......... .......... .......... .......... .......... 34% 294M 0s 2019-11-25T09:39:52.825 INFO:teuthology.orchestra.run.smithi135.stderr: 25350K .......... .......... .......... .......... .......... 34% 277M 0s 2019-11-25T09:39:52.825 INFO:teuthology.orchestra.run.smithi135.stderr: 25400K .......... .......... .......... .......... .......... 34% 325M 0s 2019-11-25T09:39:52.825 INFO:teuthology.orchestra.run.smithi135.stderr: 25450K .......... .......... .......... .......... .......... 34% 315M 0s 2019-11-25T09:39:52.825 INFO:teuthology.orchestra.run.smithi135.stderr: 25500K .......... .......... .......... .......... .......... 34% 319M 0s 2019-11-25T09:39:52.825 INFO:teuthology.orchestra.run.smithi135.stderr: 25550K .......... .......... .......... .......... .......... 34% 268M 0s 2019-11-25T09:39:52.825 INFO:teuthology.orchestra.run.smithi135.stderr: 25600K .......... .......... .......... .......... .......... 34% 315M 0s 2019-11-25T09:39:52.826 INFO:teuthology.orchestra.run.smithi135.stderr: 25650K .......... .......... .......... .......... .......... 34% 303M 0s 2019-11-25T09:39:52.826 INFO:teuthology.orchestra.run.smithi135.stderr: 25700K .......... .......... .......... .......... .......... 35% 316M 0s 2019-11-25T09:39:52.826 INFO:teuthology.orchestra.run.smithi135.stderr: 25750K .......... .......... .......... .......... .......... 35% 294M 0s 2019-11-25T09:39:52.826 INFO:teuthology.orchestra.run.smithi135.stderr: 25800K .......... .......... .......... .......... .......... 35% 322M 0s 2019-11-25T09:39:52.826 INFO:teuthology.orchestra.run.smithi135.stderr: 25850K .......... .......... .......... .......... .......... 35% 274M 0s 2019-11-25T09:39:52.826 INFO:teuthology.orchestra.run.smithi135.stderr: 25900K .......... .......... .......... .......... .......... 35% 274M 0s 2019-11-25T09:39:52.826 INFO:teuthology.orchestra.run.smithi135.stderr: 25950K .......... .......... .......... .......... .......... 35% 272M 0s 2019-11-25T09:39:52.826 INFO:teuthology.orchestra.run.smithi135.stderr: 26000K .......... .......... .......... .......... .......... 35% 266M 0s 2019-11-25T09:39:52.827 INFO:teuthology.orchestra.run.smithi135.stderr: 26050K .......... .......... .......... .......... .......... 35% 243M 0s 2019-11-25T09:39:52.827 INFO:teuthology.orchestra.run.smithi135.stderr: 26100K .......... .......... .......... .......... .......... 35% 280M 0s 2019-11-25T09:39:52.827 INFO:teuthology.orchestra.run.smithi135.stderr: 26150K .......... .......... .......... .......... .......... 35% 229M 0s 2019-11-25T09:39:52.827 INFO:teuthology.orchestra.run.smithi135.stderr: 26200K .......... .......... .......... .......... .......... 35% 307M 0s 2019-11-25T09:39:52.827 INFO:teuthology.orchestra.run.smithi135.stderr: 26250K .......... .......... .......... .......... .......... 35% 315M 0s 2019-11-25T09:39:52.827 INFO:teuthology.orchestra.run.smithi135.stderr: 26300K .......... .......... .......... .......... .......... 35% 274M 0s 2019-11-25T09:39:52.827 INFO:teuthology.orchestra.run.smithi135.stderr: 26350K .......... .......... .......... .......... .......... 35% 266M 0s 2019-11-25T09:39:52.828 INFO:teuthology.orchestra.run.smithi135.stderr: 26400K .......... .......... .......... .......... .......... 35% 304M 0s 2019-11-25T09:39:52.828 INFO:teuthology.orchestra.run.smithi135.stderr: 26450K .......... .......... .......... .......... .......... 36% 319M 0s 2019-11-25T09:39:52.828 INFO:teuthology.orchestra.run.smithi135.stderr: 26500K .......... .......... .......... .......... .......... 36% 326M 0s 2019-11-25T09:39:52.828 INFO:teuthology.orchestra.run.smithi135.stderr: 26550K .......... .......... .......... .......... .......... 36% 256M 0s 2019-11-25T09:39:52.828 INFO:teuthology.orchestra.run.smithi135.stderr: 26600K .......... .......... .......... .......... .......... 36% 314M 0s 2019-11-25T09:39:52.828 INFO:teuthology.orchestra.run.smithi135.stderr: 26650K .......... .......... .......... .......... .......... 36% 324M 0s 2019-11-25T09:39:52.828 INFO:teuthology.orchestra.run.smithi135.stderr: 26700K .......... .......... .......... .......... .......... 36% 316M 0s 2019-11-25T09:39:52.829 INFO:teuthology.orchestra.run.smithi135.stderr: 26750K .......... .......... .......... .......... .......... 36% 247M 0s 2019-11-25T09:39:52.829 INFO:teuthology.orchestra.run.smithi135.stderr: 26800K .......... .......... .......... .......... .......... 36% 306M 0s 2019-11-25T09:39:52.829 INFO:teuthology.orchestra.run.smithi135.stderr: 26850K .......... .......... .......... .......... .......... 36% 308M 0s 2019-11-25T09:39:52.829 INFO:teuthology.orchestra.run.smithi135.stderr: 26900K .......... .......... .......... .......... .......... 36% 299M 0s 2019-11-25T09:39:52.829 INFO:teuthology.orchestra.run.smithi135.stderr: 26950K .......... .......... .......... .......... .......... 36% 267M 0s 2019-11-25T09:39:52.829 INFO:teuthology.orchestra.run.smithi135.stderr: 27000K .......... .......... .......... .......... .......... 36% 304M 0s 2019-11-25T09:39:52.829 INFO:teuthology.orchestra.run.smithi135.stderr: 27050K .......... .......... .......... .......... .......... 36% 305M 0s 2019-11-25T09:39:52.830 INFO:teuthology.orchestra.run.smithi135.stderr: 27100K .......... .......... .......... .......... .......... 36% 299M 0s 2019-11-25T09:39:52.830 INFO:teuthology.orchestra.run.smithi135.stderr: 27150K .......... .......... .......... .......... .......... 36% 282M 0s 2019-11-25T09:39:52.830 INFO:teuthology.orchestra.run.smithi135.stderr: 27200K .......... .......... .......... .......... .......... 37% 311M 0s 2019-11-25T09:39:52.830 INFO:teuthology.orchestra.run.smithi135.stderr: 27250K .......... .......... .......... .......... .......... 37% 321M 0s 2019-11-25T09:39:52.830 INFO:teuthology.orchestra.run.smithi135.stderr: 27300K .......... .......... .......... .......... .......... 37% 337M 0s 2019-11-25T09:39:52.830 INFO:teuthology.orchestra.run.smithi135.stderr: 27350K .......... .......... .......... .......... .......... 37% 253M 0s 2019-11-25T09:39:52.830 INFO:teuthology.orchestra.run.smithi135.stderr: 27400K .......... .......... .......... .......... .......... 37% 336M 0s 2019-11-25T09:39:52.831 INFO:teuthology.orchestra.run.smithi135.stderr: 27450K .......... .......... .......... .......... .......... 37% 347M 0s 2019-11-25T09:39:52.831 INFO:teuthology.orchestra.run.smithi135.stderr: 27500K .......... .......... .......... .......... .......... 37% 317M 0s 2019-11-25T09:39:52.831 INFO:teuthology.orchestra.run.smithi135.stderr: 27550K .......... .......... .......... .......... .......... 37% 262M 0s 2019-11-25T09:39:52.831 INFO:teuthology.orchestra.run.smithi135.stderr: 27600K .......... .......... .......... .......... .......... 37% 307M 0s 2019-11-25T09:39:52.831 INFO:teuthology.orchestra.run.smithi135.stderr: 27650K .......... .......... .......... .......... .......... 37% 270M 0s 2019-11-25T09:39:52.831 INFO:teuthology.orchestra.run.smithi135.stderr: 27700K .......... .......... .......... .......... .......... 37% 309M 0s 2019-11-25T09:39:52.831 INFO:teuthology.orchestra.run.smithi135.stderr: 27750K .......... .......... .......... .......... .......... 37% 221M 0s 2019-11-25T09:39:52.832 INFO:teuthology.orchestra.run.smithi135.stderr: 27800K .......... .......... .......... .......... .......... 37% 295M 0s 2019-11-25T09:39:52.832 INFO:teuthology.orchestra.run.smithi135.stderr: 27850K .......... .......... .......... .......... .......... 37% 277M 0s 2019-11-25T09:39:52.832 INFO:teuthology.orchestra.run.smithi135.stderr: 27900K .......... .......... .......... .......... .......... 37% 269M 0s 2019-11-25T09:39:52.832 INFO:teuthology.orchestra.run.smithi135.stderr: 27950K .......... .......... .......... .......... .......... 38% 274M 0s 2019-11-25T09:39:52.832 INFO:teuthology.orchestra.run.smithi135.stderr: 28000K .......... .......... .......... .......... .......... 38% 332M 0s 2019-11-25T09:39:52.832 INFO:teuthology.orchestra.run.smithi135.stderr: 28050K .......... .......... .......... .......... .......... 38% 328M 0s 2019-11-25T09:39:52.832 INFO:teuthology.orchestra.run.smithi135.stderr: 28100K .......... .......... .......... .......... .......... 38% 327M 0s 2019-11-25T09:39:52.833 INFO:teuthology.orchestra.run.smithi135.stderr: 28150K .......... .......... .......... .......... .......... 38% 282M 0s 2019-11-25T09:39:52.833 INFO:teuthology.orchestra.run.smithi135.stderr: 28200K .......... .......... .......... .......... .......... 38% 321M 0s 2019-11-25T09:39:52.833 INFO:teuthology.orchestra.run.smithi135.stderr: 28250K .......... .......... .......... .......... .......... 38% 313M 0s 2019-11-25T09:39:52.833 INFO:teuthology.orchestra.run.smithi135.stderr: 28300K .......... .......... .......... .......... .......... 38% 329M 0s 2019-11-25T09:39:52.833 INFO:teuthology.orchestra.run.smithi135.stderr: 28350K .......... .......... .......... .......... .......... 38% 273M 0s 2019-11-25T09:39:52.833 INFO:teuthology.orchestra.run.smithi135.stderr: 28400K .......... .......... .......... .......... .......... 38% 313M 0s 2019-11-25T09:39:52.833 INFO:teuthology.orchestra.run.smithi135.stderr: 28450K .......... .......... .......... .......... .......... 38% 327M 0s 2019-11-25T09:39:52.834 INFO:teuthology.orchestra.run.smithi135.stderr: 28500K .......... .......... .......... .......... .......... 38% 312M 0s 2019-11-25T09:39:52.834 INFO:teuthology.orchestra.run.smithi135.stderr: 28550K .......... .......... .......... .......... .......... 38% 273M 0s 2019-11-25T09:39:52.834 INFO:teuthology.orchestra.run.smithi135.stderr: 28600K .......... .......... .......... .......... .......... 38% 293M 0s 2019-11-25T09:39:52.834 INFO:teuthology.orchestra.run.smithi135.stderr: 28650K .......... .......... .......... .......... .......... 39% 351M 0s 2019-11-25T09:39:52.834 INFO:teuthology.orchestra.run.smithi135.stderr: 28700K .......... .......... .......... .......... .......... 39% 323M 0s 2019-11-25T09:39:52.834 INFO:teuthology.orchestra.run.smithi135.stderr: 28750K .......... .......... .......... .......... .......... 39% 276M 0s 2019-11-25T09:39:52.834 INFO:teuthology.orchestra.run.smithi135.stderr: 28800K .......... .......... .......... .......... .......... 39% 321M 0s 2019-11-25T09:39:52.835 INFO:teuthology.orchestra.run.smithi135.stderr: 28850K .......... .......... .......... .......... .......... 39% 312M 0s 2019-11-25T09:39:52.835 INFO:teuthology.orchestra.run.smithi135.stderr: 28900K .......... .......... .......... .......... .......... 39% 302M 0s 2019-11-25T09:39:52.835 INFO:teuthology.orchestra.run.smithi135.stderr: 28950K .......... .......... .......... .......... .......... 39% 280M 0s 2019-11-25T09:39:52.835 INFO:teuthology.orchestra.run.smithi135.stderr: 29000K .......... .......... .......... .......... .......... 39% 292M 0s 2019-11-25T09:39:52.835 INFO:teuthology.orchestra.run.smithi135.stderr: 29050K .......... .......... .......... .......... .......... 39% 300M 0s 2019-11-25T09:39:52.835 INFO:teuthology.orchestra.run.smithi135.stderr: 29100K .......... .......... .......... .......... .......... 39% 310M 0s 2019-11-25T09:39:52.835 INFO:teuthology.orchestra.run.smithi135.stderr: 29150K .......... .......... .......... .......... .......... 39% 254M 0s 2019-11-25T09:39:52.836 INFO:teuthology.orchestra.run.smithi135.stderr: 29200K .......... .......... .......... .......... .......... 39% 309M 0s 2019-11-25T09:39:52.836 INFO:teuthology.orchestra.run.smithi135.stderr: 29250K .......... .......... .......... .......... .......... 39% 297M 0s 2019-11-25T09:39:52.836 INFO:teuthology.orchestra.run.smithi135.stderr: 29300K .......... .......... .......... .......... .......... 39% 316M 0s 2019-11-25T09:39:52.836 INFO:teuthology.orchestra.run.smithi135.stderr: 29350K .......... .......... .......... .......... .......... 39% 247M 0s 2019-11-25T09:39:52.836 INFO:teuthology.orchestra.run.smithi135.stderr: 29400K .......... .......... .......... .......... .......... 40% 324M 0s 2019-11-25T09:39:52.836 INFO:teuthology.orchestra.run.smithi135.stderr: 29450K .......... .......... .......... .......... .......... 40% 235M 0s 2019-11-25T09:39:52.836 INFO:teuthology.orchestra.run.smithi135.stderr: 29500K .......... .......... .......... .......... .......... 40% 334M 0s 2019-11-25T09:39:52.837 INFO:teuthology.orchestra.run.smithi135.stderr: 29550K .......... .......... .......... .......... .......... 40% 222M 0s 2019-11-25T09:39:52.837 INFO:teuthology.orchestra.run.smithi135.stderr: 29600K .......... .......... .......... .......... .......... 40% 238M 0s 2019-11-25T09:39:52.837 INFO:teuthology.orchestra.run.smithi135.stderr: 29650K .......... .......... .......... .......... .......... 40% 333M 0s 2019-11-25T09:39:52.837 INFO:teuthology.orchestra.run.smithi135.stderr: 29700K .......... .......... .......... .......... .......... 40% 306M 0s 2019-11-25T09:39:52.837 INFO:teuthology.orchestra.run.smithi135.stderr: 29750K .......... .......... .......... .......... .......... 40% 288M 0s 2019-11-25T09:39:52.837 INFO:teuthology.orchestra.run.smithi135.stderr: 29800K .......... .......... .......... .......... .......... 40% 321M 0s 2019-11-25T09:39:52.837 INFO:teuthology.orchestra.run.smithi135.stderr: 29850K .......... .......... .......... .......... .......... 40% 324M 0s 2019-11-25T09:39:52.838 INFO:teuthology.orchestra.run.smithi135.stderr: 29900K .......... .......... .......... .......... .......... 40% 312M 0s 2019-11-25T09:39:52.838 INFO:teuthology.orchestra.run.smithi135.stderr: 29950K .......... .......... .......... .......... .......... 40% 274M 0s 2019-11-25T09:39:52.838 INFO:teuthology.orchestra.run.smithi135.stderr: 30000K .......... .......... .......... .......... .......... 40% 327M 0s 2019-11-25T09:39:52.838 INFO:teuthology.orchestra.run.smithi135.stderr: 30050K .......... .......... .......... .......... .......... 40% 301M 0s 2019-11-25T09:39:52.838 INFO:teuthology.orchestra.run.smithi135.stderr: 30100K .......... .......... .......... .......... .......... 40% 319M 0s 2019-11-25T09:39:52.838 INFO:teuthology.orchestra.run.smithi135.stderr: 30150K .......... .......... .......... .......... .......... 41% 289M 0s 2019-11-25T09:39:52.838 INFO:teuthology.orchestra.run.smithi135.stderr: 30200K .......... .......... .......... .......... .......... 41% 293M 0s 2019-11-25T09:39:52.838 INFO:teuthology.orchestra.run.smithi135.stderr: 30250K .......... .......... .......... .......... .......... 41% 320M 0s 2019-11-25T09:39:52.839 INFO:teuthology.orchestra.run.smithi135.stderr: 30300K .......... .......... .......... .......... .......... 41% 310M 0s 2019-11-25T09:39:52.839 INFO:teuthology.orchestra.run.smithi135.stderr: 30350K .......... .......... .......... .......... .......... 41% 269M 0s 2019-11-25T09:39:52.839 INFO:teuthology.orchestra.run.smithi135.stderr: 30400K .......... .......... .......... .......... .......... 41% 342M 0s 2019-11-25T09:39:52.839 INFO:teuthology.orchestra.run.smithi135.stderr: 30450K .......... .......... .......... .......... .......... 41% 306M 0s 2019-11-25T09:39:52.839 INFO:teuthology.orchestra.run.smithi135.stderr: 30500K .......... .......... .......... .......... .......... 41% 342M 0s 2019-11-25T09:39:52.839 INFO:teuthology.orchestra.run.smithi135.stderr: 30550K .......... .......... .......... .......... .......... 41% 283M 0s 2019-11-25T09:39:52.839 INFO:teuthology.orchestra.run.smithi135.stderr: 30600K .......... .......... .......... .......... .......... 41% 351M 0s 2019-11-25T09:39:52.840 INFO:teuthology.orchestra.run.smithi135.stderr: 30650K .......... .......... .......... .......... .......... 41% 345M 0s 2019-11-25T09:39:52.840 INFO:teuthology.orchestra.run.smithi135.stderr: 30700K .......... .......... .......... .......... .......... 41% 337M 0s 2019-11-25T09:39:52.840 INFO:teuthology.orchestra.run.smithi135.stderr: 30750K .......... .......... .......... .......... .......... 41% 301M 0s 2019-11-25T09:39:52.840 INFO:teuthology.orchestra.run.smithi135.stderr: 30800K .......... .......... .......... .......... .......... 41% 323M 0s 2019-11-25T09:39:52.840 INFO:teuthology.orchestra.run.smithi135.stderr: 30850K .......... .......... .......... .......... .......... 42% 359M 0s 2019-11-25T09:39:52.840 INFO:teuthology.orchestra.run.smithi135.stderr: 30900K .......... .......... .......... .......... .......... 42% 321M 0s 2019-11-25T09:39:52.840 INFO:teuthology.orchestra.run.smithi135.stderr: 30950K .......... .......... .......... .......... .......... 42% 308M 0s 2019-11-25T09:39:52.841 INFO:teuthology.orchestra.run.smithi135.stderr: 31000K .......... .......... .......... .......... .......... 42% 303M 0s 2019-11-25T09:39:52.841 INFO:teuthology.orchestra.run.smithi135.stderr: 31050K .......... .......... .......... .......... .......... 42% 333M 0s 2019-11-25T09:39:52.841 INFO:teuthology.orchestra.run.smithi135.stderr: 31100K .......... .......... .......... .......... .......... 42% 338M 0s 2019-11-25T09:39:52.841 INFO:teuthology.orchestra.run.smithi135.stderr: 31150K .......... .......... .......... .......... .......... 42% 282M 0s 2019-11-25T09:39:52.841 INFO:teuthology.orchestra.run.smithi135.stderr: 31200K .......... .......... .......... .......... .......... 42% 352M 0s 2019-11-25T09:39:52.841 INFO:teuthology.orchestra.run.smithi135.stderr: 31250K .......... .......... .......... .......... .......... 42% 348M 0s 2019-11-25T09:39:52.841 INFO:teuthology.orchestra.run.smithi135.stderr: 31300K .......... .......... .......... .......... .......... 42% 340M 0s 2019-11-25T09:39:52.842 INFO:teuthology.orchestra.run.smithi135.stderr: 31350K .......... .......... .......... .......... .......... 42% 276M 0s 2019-11-25T09:39:52.842 INFO:teuthology.orchestra.run.smithi135.stderr: 31400K .......... .......... .......... .......... .......... 42% 306M 0s 2019-11-25T09:39:52.842 INFO:teuthology.orchestra.run.smithi135.stderr: 31450K .......... .......... .......... .......... .......... 42% 319M 0s 2019-11-25T09:39:52.842 INFO:teuthology.orchestra.run.smithi135.stderr: 31500K .......... .......... .......... .......... .......... 42% 259M 0s 2019-11-25T09:39:52.842 INFO:teuthology.orchestra.run.smithi135.stderr: 31550K .......... .......... .......... .......... .......... 42% 222M 0s 2019-11-25T09:39:52.842 INFO:teuthology.orchestra.run.smithi135.stderr: 31600K .......... .......... .......... .......... .......... 43% 287M 0s 2019-11-25T09:39:52.842 INFO:teuthology.orchestra.run.smithi135.stderr: 31650K .......... .......... .......... .......... .......... 43% 274M 0s 2019-11-25T09:39:52.843 INFO:teuthology.orchestra.run.smithi135.stderr: 31700K .......... .......... .......... .......... .......... 43% 329M 0s 2019-11-25T09:39:52.843 INFO:teuthology.orchestra.run.smithi135.stderr: 31750K .......... .......... .......... .......... .......... 43% 294M 0s 2019-11-25T09:39:52.843 INFO:teuthology.orchestra.run.smithi135.stderr: 31800K .......... .......... .......... .......... .......... 43% 319M 0s 2019-11-25T09:39:52.843 INFO:teuthology.orchestra.run.smithi135.stderr: 31850K .......... .......... .......... .......... .......... 43% 345M 0s 2019-11-25T09:39:52.843 INFO:teuthology.orchestra.run.smithi135.stderr: 31900K .......... .......... .......... .......... .......... 43% 315M 0s 2019-11-25T09:39:52.843 INFO:teuthology.orchestra.run.smithi135.stderr: 31950K .......... .......... .......... .......... .......... 43% 263M 0s 2019-11-25T09:39:52.843 INFO:teuthology.orchestra.run.smithi135.stderr: 32000K .......... .......... .......... .......... .......... 43% 324M 0s 2019-11-25T09:39:52.843 INFO:teuthology.orchestra.run.smithi135.stderr: 32050K .......... .......... .......... .......... .......... 43% 311M 0s 2019-11-25T09:39:52.844 INFO:teuthology.orchestra.run.smithi135.stderr: 32100K .......... .......... .......... .......... .......... 43% 330M 0s 2019-11-25T09:39:52.844 INFO:teuthology.orchestra.run.smithi135.stderr: 32150K .......... .......... .......... .......... .......... 43% 297M 0s 2019-11-25T09:39:52.844 INFO:teuthology.orchestra.run.smithi135.stderr: 32200K .......... .......... .......... .......... .......... 43% 321M 0s 2019-11-25T09:39:52.844 INFO:teuthology.orchestra.run.smithi135.stderr: 32250K .......... .......... .......... .......... .......... 43% 314M 0s 2019-11-25T09:39:52.844 INFO:teuthology.orchestra.run.smithi135.stderr: 32300K .......... .......... .......... .......... .......... 43% 318M 0s 2019-11-25T09:39:52.844 INFO:teuthology.orchestra.run.smithi135.stderr: 32350K .......... .......... .......... .......... .......... 44% 275M 0s 2019-11-25T09:39:52.844 INFO:teuthology.orchestra.run.smithi135.stderr: 32400K .......... .......... .......... .......... .......... 44% 344M 0s 2019-11-25T09:39:52.845 INFO:teuthology.orchestra.run.smithi135.stderr: 32450K .......... .......... .......... .......... .......... 44% 341M 0s 2019-11-25T09:39:52.845 INFO:teuthology.orchestra.run.smithi135.stderr: 32500K .......... .......... .......... .......... .......... 44% 348M 0s 2019-11-25T09:39:52.845 INFO:teuthology.orchestra.run.smithi135.stderr: 32550K .......... .......... .......... .......... .......... 44% 290M 0s 2019-11-25T09:39:52.845 INFO:teuthology.orchestra.run.smithi135.stderr: 32600K .......... .......... .......... .......... .......... 44% 225M 0s 2019-11-25T09:39:52.845 INFO:teuthology.orchestra.run.smithi135.stderr: 32650K .......... .......... .......... .......... .......... 44% 318M 0s 2019-11-25T09:39:52.845 INFO:teuthology.orchestra.run.smithi135.stderr: 32700K .......... .......... .......... .......... .......... 44% 327M 0s 2019-11-25T09:39:52.845 INFO:teuthology.orchestra.run.smithi135.stderr: 32750K .......... .......... .......... .......... .......... 44% 306M 0s 2019-11-25T09:39:52.846 INFO:teuthology.orchestra.run.smithi135.stderr: 32800K .......... .......... .......... .......... .......... 44% 326M 0s 2019-11-25T09:39:52.846 INFO:teuthology.orchestra.run.smithi135.stderr: 32850K .......... .......... .......... .......... .......... 44% 352M 0s 2019-11-25T09:39:52.846 INFO:teuthology.orchestra.run.smithi135.stderr: 32900K .......... .......... .......... .......... .......... 44% 316M 0s 2019-11-25T09:39:52.846 INFO:teuthology.orchestra.run.smithi135.stderr: 32950K .......... .......... .......... .......... .......... 44% 232M 0s 2019-11-25T09:39:52.846 INFO:teuthology.orchestra.run.smithi135.stderr: 33000K .......... .......... .......... .......... .......... 44% 262M 0s 2019-11-25T09:39:52.846 INFO:teuthology.orchestra.run.smithi135.stderr: 33050K .......... .......... .......... .......... .......... 44% 322M 0s 2019-11-25T09:39:52.846 INFO:teuthology.orchestra.run.smithi135.stderr: 33100K .......... .......... .......... .......... .......... 45% 334M 0s 2019-11-25T09:39:52.847 INFO:teuthology.orchestra.run.smithi135.stderr: 33150K .......... .......... .......... .......... .......... 45% 274M 0s 2019-11-25T09:39:52.847 INFO:teuthology.orchestra.run.smithi135.stderr: 33200K .......... .......... .......... .......... .......... 45% 340M 0s 2019-11-25T09:39:52.847 INFO:teuthology.orchestra.run.smithi135.stderr: 33250K .......... .......... .......... .......... .......... 45% 312M 0s 2019-11-25T09:39:52.847 INFO:teuthology.orchestra.run.smithi135.stderr: 33300K .......... .......... .......... .......... .......... 45% 318M 0s 2019-11-25T09:39:52.847 INFO:teuthology.orchestra.run.smithi135.stderr: 33350K .......... .......... .......... .......... .......... 45% 247M 0s 2019-11-25T09:39:52.847 INFO:teuthology.orchestra.run.smithi135.stderr: 33400K .......... .......... .......... .......... .......... 45% 298M 0s 2019-11-25T09:39:52.847 INFO:teuthology.orchestra.run.smithi135.stderr: 33450K .......... .......... .......... .......... .......... 45% 334M 0s 2019-11-25T09:39:52.848 INFO:teuthology.orchestra.run.smithi135.stderr: 33500K .......... .......... .......... .......... .......... 45% 297M 0s 2019-11-25T09:39:52.848 INFO:teuthology.orchestra.run.smithi135.stderr: 33550K .......... .......... .......... .......... .......... 45% 257M 0s 2019-11-25T09:39:52.848 INFO:teuthology.orchestra.run.smithi135.stderr: 33600K .......... .......... .......... .......... .......... 45% 211M 0s 2019-11-25T09:39:52.848 INFO:teuthology.orchestra.run.smithi135.stderr: 33650K .......... .......... .......... .......... .......... 45% 185M 0s 2019-11-25T09:39:52.848 INFO:teuthology.orchestra.run.smithi135.stderr: 33700K .......... .......... .......... .......... .......... 45% 213M 0s 2019-11-25T09:39:52.848 INFO:teuthology.orchestra.run.smithi135.stderr: 33750K .......... .......... .......... .......... .......... 45% 229M 0s 2019-11-25T09:39:52.848 INFO:teuthology.orchestra.run.smithi135.stderr: 33800K .......... .......... .......... .......... .......... 46% 276M 0s 2019-11-25T09:39:52.849 INFO:teuthology.orchestra.run.smithi135.stderr: 33850K .......... .......... .......... .......... .......... 46% 321M 0s 2019-11-25T09:39:52.849 INFO:teuthology.orchestra.run.smithi135.stderr: 33900K .......... .......... .......... .......... .......... 46% 259M 0s 2019-11-25T09:39:52.849 INFO:teuthology.orchestra.run.smithi135.stderr: 33950K .......... .......... .......... .......... .......... 46% 155M 0s 2019-11-25T09:39:52.849 INFO:teuthology.orchestra.run.smithi135.stderr: 34000K .......... .......... .......... .......... .......... 46% 262M 0s 2019-11-25T09:39:52.849 INFO:teuthology.orchestra.run.smithi135.stderr: 34050K .......... .......... .......... .......... .......... 46% 297M 0s 2019-11-25T09:39:52.849 INFO:teuthology.orchestra.run.smithi135.stderr: 34100K .......... .......... .......... .......... .......... 46% 279M 0s 2019-11-25T09:39:52.849 INFO:teuthology.orchestra.run.smithi135.stderr: 34150K .......... .......... .......... .......... .......... 46% 281M 0s 2019-11-25T09:39:52.850 INFO:teuthology.orchestra.run.smithi135.stderr: 34200K .......... .......... .......... .......... .......... 46% 356M 0s 2019-11-25T09:39:52.850 INFO:teuthology.orchestra.run.smithi135.stderr: 34250K .......... .......... .......... .......... .......... 46% 315M 0s 2019-11-25T09:39:52.850 INFO:teuthology.orchestra.run.smithi135.stderr: 34300K .......... .......... .......... .......... .......... 46% 340M 0s 2019-11-25T09:39:52.850 INFO:teuthology.orchestra.run.smithi135.stderr: 34350K .......... .......... .......... .......... .......... 46% 292M 0s 2019-11-25T09:39:52.850 INFO:teuthology.orchestra.run.smithi135.stderr: 34400K .......... .......... .......... .......... .......... 46% 348M 0s 2019-11-25T09:39:52.850 INFO:teuthology.orchestra.run.smithi135.stderr: 34450K .......... .......... .......... .......... .......... 46% 354M 0s 2019-11-25T09:39:52.850 INFO:teuthology.orchestra.run.smithi135.stderr: 34500K .......... .......... .......... .......... .......... 46% 331M 0s 2019-11-25T09:39:52.850 INFO:teuthology.orchestra.run.smithi135.stderr: 34550K .......... .......... .......... .......... .......... 47% 305M 0s 2019-11-25T09:39:52.851 INFO:teuthology.orchestra.run.smithi135.stderr: 34600K .......... .......... .......... .......... .......... 47% 340M 0s 2019-11-25T09:39:52.851 INFO:teuthology.orchestra.run.smithi135.stderr: 34650K .......... .......... .......... .......... .......... 47% 316M 0s 2019-11-25T09:39:52.851 INFO:teuthology.orchestra.run.smithi135.stderr: 34700K .......... .......... .......... .......... .......... 47% 334M 0s 2019-11-25T09:39:52.851 INFO:teuthology.orchestra.run.smithi135.stderr: 34750K .......... .......... .......... .......... .......... 47% 314M 0s 2019-11-25T09:39:52.851 INFO:teuthology.orchestra.run.smithi135.stderr: 34800K .......... .......... .......... .......... .......... 47% 351M 0s 2019-11-25T09:39:52.851 INFO:teuthology.orchestra.run.smithi135.stderr: 34850K .......... .......... .......... .......... .......... 47% 347M 0s 2019-11-25T09:39:52.851 INFO:teuthology.orchestra.run.smithi135.stderr: 34900K .......... .......... .......... .......... .......... 47% 327M 0s 2019-11-25T09:39:52.852 INFO:teuthology.orchestra.run.smithi135.stderr: 34950K .......... .......... .......... .......... .......... 47% 312M 0s 2019-11-25T09:39:52.852 INFO:teuthology.orchestra.run.smithi135.stderr: 35000K .......... .......... .......... .......... .......... 47% 341M 0s 2019-11-25T09:39:52.852 INFO:teuthology.orchestra.run.smithi135.stderr: 35050K .......... .......... .......... .......... .......... 47% 352M 0s 2019-11-25T09:39:52.852 INFO:teuthology.orchestra.run.smithi135.stderr: 35100K .......... .......... .......... .......... .......... 47% 342M 0s 2019-11-25T09:39:52.852 INFO:teuthology.orchestra.run.smithi135.stderr: 35150K .......... .......... .......... .......... .......... 47% 306M 0s 2019-11-25T09:39:52.852 INFO:teuthology.orchestra.run.smithi135.stderr: 35200K .......... .......... .......... .......... .......... 47% 345M 0s 2019-11-25T09:39:52.852 INFO:teuthology.orchestra.run.smithi135.stderr: 35250K .......... .......... .......... .......... .......... 47% 356M 0s 2019-11-25T09:39:52.853 INFO:teuthology.orchestra.run.smithi135.stderr: 35300K .......... .......... .......... .......... .......... 48% 330M 0s 2019-11-25T09:39:52.853 INFO:teuthology.orchestra.run.smithi135.stderr: 35350K .......... .......... .......... .......... .......... 48% 312M 0s 2019-11-25T09:39:52.853 INFO:teuthology.orchestra.run.smithi135.stderr: 35400K .......... .......... .......... .......... .......... 48% 367M 0s 2019-11-25T09:39:52.853 INFO:teuthology.orchestra.run.smithi135.stderr: 35450K .......... .......... .......... .......... .......... 48% 341M 0s 2019-11-25T09:39:52.853 INFO:teuthology.orchestra.run.smithi135.stderr: 35500K .......... .......... .......... .......... .......... 48% 354M 0s 2019-11-25T09:39:52.853 INFO:teuthology.orchestra.run.smithi135.stderr: 35550K .......... .......... .......... .......... .......... 48% 277M 0s 2019-11-25T09:39:52.853 INFO:teuthology.orchestra.run.smithi135.stderr: 35600K .......... .......... .......... .......... .......... 48% 291M 0s 2019-11-25T09:39:52.854 INFO:teuthology.orchestra.run.smithi135.stderr: 35650K .......... .......... .......... .......... .......... 48% 316M 0s 2019-11-25T09:39:52.854 INFO:teuthology.orchestra.run.smithi135.stderr: 35700K .......... .......... .......... .......... .......... 48% 330M 0s 2019-11-25T09:39:52.854 INFO:teuthology.orchestra.run.smithi135.stderr: 35750K .......... .......... .......... .......... .......... 48% 247M 0s 2019-11-25T09:39:52.854 INFO:teuthology.orchestra.run.smithi135.stderr: 35800K .......... .......... .......... .......... .......... 48% 390M 0s 2019-11-25T09:39:52.854 INFO:teuthology.orchestra.run.smithi135.stderr: 35850K .......... .......... .......... .......... .......... 48% 391M 0s 2019-11-25T09:39:52.854 INFO:teuthology.orchestra.run.smithi135.stderr: 35900K .......... .......... .......... .......... .......... 48% 190M 0s 2019-11-25T09:39:52.854 INFO:teuthology.orchestra.run.smithi135.stderr: 35950K .......... .......... .......... .......... .......... 48% 186M 0s 2019-11-25T09:39:52.855 INFO:teuthology.orchestra.run.smithi135.stderr: 36000K .......... .......... .......... .......... .......... 49% 248M 0s 2019-11-25T09:39:52.855 INFO:teuthology.orchestra.run.smithi135.stderr: 36050K .......... .......... .......... .......... .......... 49% 205M 0s 2019-11-25T09:39:52.855 INFO:teuthology.orchestra.run.smithi135.stderr: 36100K .......... .......... .......... .......... .......... 49% 263M 0s 2019-11-25T09:39:52.855 INFO:teuthology.orchestra.run.smithi135.stderr: 36150K .......... .......... .......... .......... .......... 49% 208M 0s 2019-11-25T09:39:52.855 INFO:teuthology.orchestra.run.smithi135.stderr: 36200K .......... .......... .......... .......... .......... 49% 259M 0s 2019-11-25T09:39:52.855 INFO:teuthology.orchestra.run.smithi135.stderr: 36250K .......... .......... .......... .......... .......... 49% 273M 0s 2019-11-25T09:39:52.855 INFO:teuthology.orchestra.run.smithi135.stderr: 36300K .......... .......... .......... .......... .......... 49% 385M 0s 2019-11-25T09:39:52.856 INFO:teuthology.orchestra.run.smithi135.stderr: 36350K .......... .......... .......... .......... .......... 49% 341M 0s 2019-11-25T09:39:52.856 INFO:teuthology.orchestra.run.smithi135.stderr: 36400K .......... .......... .......... .......... .......... 49% 323M 0s 2019-11-25T09:39:52.856 INFO:teuthology.orchestra.run.smithi135.stderr: 36450K .......... .......... .......... .......... .......... 49% 375M 0s 2019-11-25T09:39:52.856 INFO:teuthology.orchestra.run.smithi135.stderr: 36500K .......... .......... .......... .......... .......... 49% 397M 0s 2019-11-25T09:39:52.856 INFO:teuthology.orchestra.run.smithi135.stderr: 36550K .......... .......... .......... .......... .......... 49% 329M 0s 2019-11-25T09:39:52.856 INFO:teuthology.orchestra.run.smithi135.stderr: 36600K .......... .......... .......... .......... .......... 49% 391M 0s 2019-11-25T09:39:52.856 INFO:teuthology.orchestra.run.smithi135.stderr: 36650K .......... .......... .......... .......... .......... 49% 391M 0s 2019-11-25T09:39:52.857 INFO:teuthology.orchestra.run.smithi135.stderr: 36700K .......... .......... .......... .......... .......... 49% 399M 0s 2019-11-25T09:39:52.857 INFO:teuthology.orchestra.run.smithi135.stderr: 36750K .......... .......... .......... .......... .......... 50% 331M 0s 2019-11-25T09:39:52.857 INFO:teuthology.orchestra.run.smithi135.stderr: 36800K .......... .......... .......... .......... .......... 50% 395M 0s 2019-11-25T09:39:52.857 INFO:teuthology.orchestra.run.smithi135.stderr: 36850K .......... .......... .......... .......... .......... 50% 366M 0s 2019-11-25T09:39:52.857 INFO:teuthology.orchestra.run.smithi135.stderr: 36900K .......... .......... .......... .......... .......... 50% 387M 0s 2019-11-25T09:39:52.857 INFO:teuthology.orchestra.run.smithi135.stderr: 36950K .......... .......... .......... .......... .......... 50% 357M 0s 2019-11-25T09:39:52.857 INFO:teuthology.orchestra.run.smithi135.stderr: 37000K .......... .......... .......... .......... .......... 50% 426M 0s 2019-11-25T09:39:52.857 INFO:teuthology.orchestra.run.smithi135.stderr: 37050K .......... .......... .......... .......... .......... 50% 420M 0s 2019-11-25T09:39:52.858 INFO:teuthology.orchestra.run.smithi135.stderr: 37100K .......... .......... .......... .......... .......... 50% 404M 0s 2019-11-25T09:39:52.858 INFO:teuthology.orchestra.run.smithi135.stderr: 37150K .......... .......... .......... .......... .......... 50% 330M 0s 2019-11-25T09:39:52.858 INFO:teuthology.orchestra.run.smithi135.stderr: 37200K .......... .......... .......... .......... .......... 50% 409M 0s 2019-11-25T09:39:52.858 INFO:teuthology.orchestra.run.smithi135.stderr: 37250K .......... .......... .......... .......... .......... 50% 388M 0s 2019-11-25T09:39:52.858 INFO:teuthology.orchestra.run.smithi135.stderr: 37300K .......... .......... .......... .......... .......... 50% 393M 0s 2019-11-25T09:39:52.858 INFO:teuthology.orchestra.run.smithi135.stderr: 37350K .......... .......... .......... .......... .......... 50% 315M 0s 2019-11-25T09:39:52.858 INFO:teuthology.orchestra.run.smithi135.stderr: 37400K .......... .......... .......... .......... .......... 50% 375M 0s 2019-11-25T09:39:52.859 INFO:teuthology.orchestra.run.smithi135.stderr: 37450K .......... .......... .......... .......... .......... 50% 418M 0s 2019-11-25T09:39:52.859 INFO:teuthology.orchestra.run.smithi135.stderr: 37500K .......... .......... .......... .......... .......... 51% 415M 0s 2019-11-25T09:39:52.859 INFO:teuthology.orchestra.run.smithi135.stderr: 37550K .......... .......... .......... .......... .......... 51% 353M 0s 2019-11-25T09:39:52.859 INFO:teuthology.orchestra.run.smithi135.stderr: 37600K .......... .......... .......... .......... .......... 51% 357M 0s 2019-11-25T09:39:52.859 INFO:teuthology.orchestra.run.smithi135.stderr: 37650K .......... .......... .......... .......... .......... 51% 330M 0s 2019-11-25T09:39:52.859 INFO:teuthology.orchestra.run.smithi135.stderr: 37700K .......... .......... .......... .......... .......... 51% 325M 0s 2019-11-25T09:39:52.859 INFO:teuthology.orchestra.run.smithi135.stderr: 37750K .......... .......... .......... .......... .......... 51% 308M 0s 2019-11-25T09:39:52.860 INFO:teuthology.orchestra.run.smithi135.stderr: 37800K .......... .......... .......... .......... .......... 51% 385M 0s 2019-11-25T09:39:52.860 INFO:teuthology.orchestra.run.smithi135.stderr: 37850K .......... .......... .......... .......... .......... 51% 333M 0s 2019-11-25T09:39:52.860 INFO:teuthology.orchestra.run.smithi135.stderr: 37900K .......... .......... .......... .......... .......... 51% 288M 0s 2019-11-25T09:39:52.860 INFO:teuthology.orchestra.run.smithi135.stderr: 37950K .......... .......... .......... .......... .......... 51% 273M 0s 2019-11-25T09:39:52.860 INFO:teuthology.orchestra.run.smithi135.stderr: 38000K .......... .......... .......... .......... .......... 51% 336M 0s 2019-11-25T09:39:52.860 INFO:teuthology.orchestra.run.smithi135.stderr: 38050K .......... .......... .......... .......... .......... 51% 376M 0s 2019-11-25T09:39:52.860 INFO:teuthology.orchestra.run.smithi135.stderr: 38100K .......... .......... .......... .......... .......... 51% 348M 0s 2019-11-25T09:39:52.861 INFO:teuthology.orchestra.run.smithi135.stderr: 38150K .......... .......... .......... .......... .......... 51% 362M 0s 2019-11-25T09:39:52.861 INFO:teuthology.orchestra.run.smithi135.stderr: 38200K .......... .......... .......... .......... .......... 51% 397M 0s 2019-11-25T09:39:52.861 INFO:teuthology.orchestra.run.smithi135.stderr: 38250K .......... .......... .......... .......... .......... 52% 381M 0s 2019-11-25T09:39:52.861 INFO:teuthology.orchestra.run.smithi135.stderr: 38300K .......... .......... .......... .......... .......... 52% 386M 0s 2019-11-25T09:39:52.861 INFO:teuthology.orchestra.run.smithi135.stderr: 38350K .......... .......... .......... .......... .......... 52% 361M 0s 2019-11-25T09:39:52.861 INFO:teuthology.orchestra.run.smithi135.stderr: 38400K .......... .......... .......... .......... .......... 52% 401M 0s 2019-11-25T09:39:52.861 INFO:teuthology.orchestra.run.smithi135.stderr: 38450K .......... .......... .......... .......... .......... 52% 405M 0s 2019-11-25T09:39:52.862 INFO:teuthology.orchestra.run.smithi135.stderr: 38500K .......... .......... .......... .......... .......... 52% 396M 0s 2019-11-25T09:39:52.862 INFO:teuthology.orchestra.run.smithi135.stderr: 38550K .......... .......... .......... .......... .......... 52% 324M 0s 2019-11-25T09:39:52.862 INFO:teuthology.orchestra.run.smithi135.stderr: 38600K .......... .......... .......... .......... .......... 52% 415M 0s 2019-11-25T09:39:52.862 INFO:teuthology.orchestra.run.smithi135.stderr: 38650K .......... .......... .......... .......... .......... 52% 414M 0s 2019-11-25T09:39:52.862 INFO:teuthology.orchestra.run.smithi135.stderr: 38700K .......... .......... .......... .......... .......... 52% 394M 0s 2019-11-25T09:39:52.862 INFO:teuthology.orchestra.run.smithi135.stderr: 38750K .......... .......... .......... .......... .......... 52% 336M 0s 2019-11-25T09:39:52.862 INFO:teuthology.orchestra.run.smithi135.stderr: 38800K .......... .......... .......... .......... .......... 52% 378M 0s 2019-11-25T09:39:52.863 INFO:teuthology.orchestra.run.smithi135.stderr: 38850K .......... .......... .......... .......... .......... 52% 421M 0s 2019-11-25T09:39:52.863 INFO:teuthology.orchestra.run.smithi135.stderr: 38900K .......... .......... .......... .......... .......... 52% 399M 0s 2019-11-25T09:39:52.863 INFO:teuthology.orchestra.run.smithi135.stderr: 38950K .......... .......... .......... .......... .......... 53% 367M 0s 2019-11-25T09:39:52.863 INFO:teuthology.orchestra.run.smithi135.stderr: 39000K .......... .......... .......... .......... .......... 53% 412M 0s 2019-11-25T09:39:52.863 INFO:teuthology.orchestra.run.smithi135.stderr: 39050K .......... .......... .......... .......... .......... 53% 414M 0s 2019-11-25T09:39:52.863 INFO:teuthology.orchestra.run.smithi135.stderr: 39100K .......... .......... .......... .......... .......... 53% 363M 0s 2019-11-25T09:39:52.863 INFO:teuthology.orchestra.run.smithi135.stderr: 39150K .......... .......... .......... .......... .......... 53% 347M 0s 2019-11-25T09:39:52.864 INFO:teuthology.orchestra.run.smithi135.stderr: 39200K .......... .......... .......... .......... .......... 53% 346M 0s 2019-11-25T09:39:52.864 INFO:teuthology.orchestra.run.smithi135.stderr: 39250K .......... .......... .......... .......... .......... 53% 355M 0s 2019-11-25T09:39:52.864 INFO:teuthology.orchestra.run.smithi135.stderr: 39300K .......... .......... .......... .......... .......... 53% 401M 0s 2019-11-25T09:39:52.864 INFO:teuthology.orchestra.run.smithi135.stderr: 39350K .......... .......... .......... .......... .......... 53% 320M 0s 2019-11-25T09:39:52.864 INFO:teuthology.orchestra.run.smithi135.stderr: 39400K .......... .......... .......... .......... .......... 53% 348M 0s 2019-11-25T09:39:52.864 INFO:teuthology.orchestra.run.smithi135.stderr: 39450K .......... .......... .......... .......... .......... 53% 278M 0s 2019-11-25T09:39:52.864 INFO:teuthology.orchestra.run.smithi135.stderr: 39500K .......... .......... .......... .......... .......... 53% 211M 0s 2019-11-25T09:39:52.865 INFO:teuthology.orchestra.run.smithi135.stderr: 39550K .......... .......... .......... .......... .......... 53% 248M 0s 2019-11-25T09:39:52.865 INFO:teuthology.orchestra.run.smithi135.stderr: 39600K .......... .......... .......... .......... .......... 53% 317M 0s 2019-11-25T09:39:52.865 INFO:teuthology.orchestra.run.smithi135.stderr: 39650K .......... .......... .......... .......... .......... 53% 354M 0s 2019-11-25T09:39:52.865 INFO:teuthology.orchestra.run.smithi135.stderr: 39700K .......... .......... .......... .......... .......... 54% 358M 0s 2019-11-25T09:39:52.865 INFO:teuthology.orchestra.run.smithi135.stderr: 39750K .......... .......... .......... .......... .......... 54% 341M 0s 2019-11-25T09:39:52.865 INFO:teuthology.orchestra.run.smithi135.stderr: 39800K .......... .......... .......... .......... .......... 54% 399M 0s 2019-11-25T09:39:52.865 INFO:teuthology.orchestra.run.smithi135.stderr: 39850K .......... .......... .......... .......... .......... 54% 403M 0s 2019-11-25T09:39:52.866 INFO:teuthology.orchestra.run.smithi135.stderr: 39900K .......... .......... .......... .......... .......... 54% 406M 0s 2019-11-25T09:39:52.866 INFO:teuthology.orchestra.run.smithi135.stderr: 39950K .......... .......... .......... .......... .......... 54% 334M 0s 2019-11-25T09:39:52.866 INFO:teuthology.orchestra.run.smithi135.stderr: 40000K .......... .......... .......... .......... .......... 54% 405M 0s 2019-11-25T09:39:52.866 INFO:teuthology.orchestra.run.smithi135.stderr: 40050K .......... .......... .......... .......... .......... 54% 382M 0s 2019-11-25T09:39:52.866 INFO:teuthology.orchestra.run.smithi135.stderr: 40100K .......... .......... .......... .......... .......... 54% 385M 0s 2019-11-25T09:39:52.866 INFO:teuthology.orchestra.run.smithi135.stderr: 40150K .......... .......... .......... .......... .......... 54% 343M 0s 2019-11-25T09:39:52.866 INFO:teuthology.orchestra.run.smithi135.stderr: 40200K .......... .......... .......... .......... .......... 54% 417M 0s 2019-11-25T09:39:52.866 INFO:teuthology.orchestra.run.smithi135.stderr: 40250K .......... .......... .......... .......... .......... 54% 414M 0s 2019-11-25T09:39:52.867 INFO:teuthology.orchestra.run.smithi135.stderr: 40300K .......... .......... .......... .......... .......... 54% 411M 0s 2019-11-25T09:39:52.867 INFO:teuthology.orchestra.run.smithi135.stderr: 40350K .......... .......... .......... .......... .......... 54% 340M 0s 2019-11-25T09:39:52.867 INFO:teuthology.orchestra.run.smithi135.stderr: 40400K .......... .......... .......... .......... .......... 54% 317M 0s 2019-11-25T09:39:52.867 INFO:teuthology.orchestra.run.smithi135.stderr: 40450K .......... .......... .......... .......... .......... 55% 372M 0s 2019-11-25T09:39:52.867 INFO:teuthology.orchestra.run.smithi135.stderr: 40500K .......... .......... .......... .......... .......... 55% 333M 0s 2019-11-25T09:39:52.867 INFO:teuthology.orchestra.run.smithi135.stderr: 40550K .......... .......... .......... .......... .......... 55% 338M 0s 2019-11-25T09:39:52.867 INFO:teuthology.orchestra.run.smithi135.stderr: 40600K .......... .......... .......... .......... .......... 55% 325M 0s 2019-11-25T09:39:52.868 INFO:teuthology.orchestra.run.smithi135.stderr: 40650K .......... .......... .......... .......... .......... 55% 362M 0s 2019-11-25T09:39:52.868 INFO:teuthology.orchestra.run.smithi135.stderr: 40700K .......... .......... .......... .......... .......... 55% 350M 0s 2019-11-25T09:39:52.868 INFO:teuthology.orchestra.run.smithi135.stderr: 40750K .......... .......... .......... .......... .......... 55% 335M 0s 2019-11-25T09:39:52.868 INFO:teuthology.orchestra.run.smithi135.stderr: 40800K .......... .......... .......... .......... .......... 55% 417M 0s 2019-11-25T09:39:52.868 INFO:teuthology.orchestra.run.smithi135.stderr: 40850K .......... .......... .......... .......... .......... 55% 412M 0s 2019-11-25T09:39:52.868 INFO:teuthology.orchestra.run.smithi135.stderr: 40900K .......... .......... .......... .......... .......... 55% 419M 0s 2019-11-25T09:39:52.868 INFO:teuthology.orchestra.run.smithi135.stderr: 40950K .......... .......... .......... .......... .......... 55% 336M 0s 2019-11-25T09:39:52.869 INFO:teuthology.orchestra.run.smithi135.stderr: 41000K .......... .......... .......... .......... .......... 55% 411M 0s 2019-11-25T09:39:52.869 INFO:teuthology.orchestra.run.smithi135.stderr: 41050K .......... .......... .......... .......... .......... 55% 399M 0s 2019-11-25T09:39:52.869 INFO:teuthology.orchestra.run.smithi135.stderr: 41100K .......... .......... .......... .......... .......... 55% 412M 0s 2019-11-25T09:39:52.869 INFO:teuthology.orchestra.run.smithi135.stderr: 41150K .......... .......... .......... .......... .......... 56% 344M 0s 2019-11-25T09:39:52.869 INFO:teuthology.orchestra.run.smithi135.stderr: 41200K .......... .......... .......... .......... .......... 56% 423M 0s 2019-11-25T09:39:52.869 INFO:teuthology.orchestra.run.smithi135.stderr: 41250K .......... .......... .......... .......... .......... 56% 398M 0s 2019-11-25T09:39:52.869 INFO:teuthology.orchestra.run.smithi135.stderr: 41300K .......... .......... .......... .......... .......... 56% 391M 0s 2019-11-25T09:39:52.870 INFO:teuthology.orchestra.run.smithi135.stderr: 41350K .......... .......... .......... .......... .......... 56% 343M 0s 2019-11-25T09:39:52.870 INFO:teuthology.orchestra.run.smithi135.stderr: 41400K .......... .......... .......... .......... .......... 56% 415M 0s 2019-11-25T09:39:52.870 INFO:teuthology.orchestra.run.smithi135.stderr: 41450K .......... .......... .......... .......... .......... 56% 407M 0s 2019-11-25T09:39:52.870 INFO:teuthology.orchestra.run.smithi135.stderr: 41500K .......... .......... .......... .......... .......... 56% 406M 0s 2019-11-25T09:39:52.870 INFO:teuthology.orchestra.run.smithi135.stderr: 41550K .......... .......... .......... .......... .......... 56% 341M 0s 2019-11-25T09:39:52.870 INFO:teuthology.orchestra.run.smithi135.stderr: 41600K .......... .......... .......... .......... .......... 56% 373M 0s 2019-11-25T09:39:52.870 INFO:teuthology.orchestra.run.smithi135.stderr: 41650K .......... .......... .......... .......... .......... 56% 362M 0s 2019-11-25T09:39:52.870 INFO:teuthology.orchestra.run.smithi135.stderr: 41700K .......... .......... .......... .......... .......... 56% 316M 0s 2019-11-25T09:39:52.871 INFO:teuthology.orchestra.run.smithi135.stderr: 41750K .......... .......... .......... .......... .......... 56% 330M 0s 2019-11-25T09:39:52.871 INFO:teuthology.orchestra.run.smithi135.stderr: 41800K .......... .......... .......... .......... .......... 56% 368M 0s 2019-11-25T09:39:52.871 INFO:teuthology.orchestra.run.smithi135.stderr: 41850K .......... .......... .......... .......... .......... 56% 350M 0s 2019-11-25T09:39:52.871 INFO:teuthology.orchestra.run.smithi135.stderr: 41900K .......... .......... .......... .......... .......... 57% 370M 0s 2019-11-25T09:39:52.871 INFO:teuthology.orchestra.run.smithi135.stderr: 41950K .......... .......... .......... .......... .......... 57% 342M 0s 2019-11-25T09:39:52.871 INFO:teuthology.orchestra.run.smithi135.stderr: 42000K .......... .......... .......... .......... .......... 57% 275M 0s 2019-11-25T09:39:52.871 INFO:teuthology.orchestra.run.smithi135.stderr: 42050K .......... .......... .......... .......... .......... 57% 308M 0s 2019-11-25T09:39:52.872 INFO:teuthology.orchestra.run.smithi135.stderr: 42100K .......... .......... .......... .......... .......... 57% 312M 0s 2019-11-25T09:39:52.872 INFO:teuthology.orchestra.run.smithi135.stderr: 42150K .......... .......... .......... .......... .......... 57% 265M 0s 2019-11-25T09:39:52.872 INFO:teuthology.orchestra.run.smithi135.stderr: 42200K .......... .......... .......... .......... .......... 57% 284M 0s 2019-11-25T09:39:52.872 INFO:teuthology.orchestra.run.smithi135.stderr: 42250K .......... .......... .......... .......... .......... 57% 301M 0s 2019-11-25T09:39:52.872 INFO:teuthology.orchestra.run.smithi135.stderr: 42300K .......... .......... .......... .......... .......... 57% 293M 0s 2019-11-25T09:39:52.872 INFO:teuthology.orchestra.run.smithi135.stderr: 42350K .......... .......... .......... .......... .......... 57% 252M 0s 2019-11-25T09:39:52.872 INFO:teuthology.orchestra.run.smithi135.stderr: 42400K .......... .......... .......... .......... .......... 57% 303M 0s 2019-11-25T09:39:52.873 INFO:teuthology.orchestra.run.smithi135.stderr: 42450K .......... .......... .......... .......... .......... 57% 279M 0s 2019-11-25T09:39:52.873 INFO:teuthology.orchestra.run.smithi135.stderr: 42500K .......... .......... .......... .......... .......... 57% 307M 0s 2019-11-25T09:39:52.873 INFO:teuthology.orchestra.run.smithi135.stderr: 42550K .......... .......... .......... .......... .......... 57% 246M 0s 2019-11-25T09:39:52.873 INFO:teuthology.orchestra.run.smithi135.stderr: 42600K .......... .......... .......... .......... .......... 57% 288M 0s 2019-11-25T09:39:52.873 INFO:teuthology.orchestra.run.smithi135.stderr: 42650K .......... .......... .......... .......... .......... 58% 285M 0s 2019-11-25T09:39:52.873 INFO:teuthology.orchestra.run.smithi135.stderr: 42700K .......... .......... .......... .......... .......... 58% 287M 0s 2019-11-25T09:39:52.873 INFO:teuthology.orchestra.run.smithi135.stderr: 42750K .......... .......... .......... .......... .......... 58% 212M 0s 2019-11-25T09:39:52.874 INFO:teuthology.orchestra.run.smithi135.stderr: 42800K .......... .......... .......... .......... .......... 58% 275M 0s 2019-11-25T09:39:52.874 INFO:teuthology.orchestra.run.smithi135.stderr: 42850K .......... .......... .......... .......... .......... 58% 279M 0s 2019-11-25T09:39:52.874 INFO:teuthology.orchestra.run.smithi135.stderr: 42900K .......... .......... .......... .......... .......... 58% 230M 0s 2019-11-25T09:39:52.874 INFO:teuthology.orchestra.run.smithi135.stderr: 42950K .......... .......... .......... .......... .......... 58% 230M 0s 2019-11-25T09:39:52.874 INFO:teuthology.orchestra.run.smithi135.stderr: 43000K .......... .......... .......... .......... .......... 58% 269M 0s 2019-11-25T09:39:52.874 INFO:teuthology.orchestra.run.smithi135.stderr: 43050K .......... .......... .......... .......... .......... 58% 294M 0s 2019-11-25T09:39:52.874 INFO:teuthology.orchestra.run.smithi135.stderr: 43100K .......... .......... .......... .......... .......... 58% 301M 0s 2019-11-25T09:39:52.875 INFO:teuthology.orchestra.run.smithi135.stderr: 43150K .......... .......... .......... .......... .......... 58% 263M 0s 2019-11-25T09:39:52.875 INFO:teuthology.orchestra.run.smithi135.stderr: 43200K .......... .......... .......... .......... .......... 58% 298M 0s 2019-11-25T09:39:52.875 INFO:teuthology.orchestra.run.smithi135.stderr: 43250K .......... .......... .......... .......... .......... 58% 297M 0s 2019-11-25T09:39:52.875 INFO:teuthology.orchestra.run.smithi135.stderr: 43300K .......... .......... .......... .......... .......... 58% 300M 0s 2019-11-25T09:39:52.875 INFO:teuthology.orchestra.run.smithi135.stderr: 43350K .......... .......... .......... .......... .......... 59% 251M 0s 2019-11-25T09:39:52.875 INFO:teuthology.orchestra.run.smithi135.stderr: 43400K .......... .......... .......... .......... .......... 59% 290M 0s 2019-11-25T09:39:52.875 INFO:teuthology.orchestra.run.smithi135.stderr: 43450K .......... .......... .......... .......... .......... 59% 277M 0s 2019-11-25T09:39:52.876 INFO:teuthology.orchestra.run.smithi135.stderr: 43500K .......... .......... .......... .......... .......... 59% 294M 0s 2019-11-25T09:39:52.876 INFO:teuthology.orchestra.run.smithi135.stderr: 43550K .......... .......... .......... .......... .......... 59% 266M 0s 2019-11-25T09:39:52.876 INFO:teuthology.orchestra.run.smithi135.stderr: 43600K .......... .......... .......... .......... .......... 59% 303M 0s 2019-11-25T09:39:52.876 INFO:teuthology.orchestra.run.smithi135.stderr: 43650K .......... .......... .......... .......... .......... 59% 303M 0s 2019-11-25T09:39:52.876 INFO:teuthology.orchestra.run.smithi135.stderr: 43700K .......... .......... .......... .......... .......... 59% 287M 0s 2019-11-25T09:39:52.876 INFO:teuthology.orchestra.run.smithi135.stderr: 43750K .......... .......... .......... .......... .......... 59% 241M 0s 2019-11-25T09:39:52.876 INFO:teuthology.orchestra.run.smithi135.stderr: 43800K .......... .......... .......... .......... .......... 59% 295M 0s 2019-11-25T09:39:52.877 INFO:teuthology.orchestra.run.smithi135.stderr: 43850K .......... .......... .......... .......... .......... 59% 295M 0s 2019-11-25T09:39:52.877 INFO:teuthology.orchestra.run.smithi135.stderr: 43900K .......... .......... .......... .......... .......... 59% 301M 0s 2019-11-25T09:39:52.877 INFO:teuthology.orchestra.run.smithi135.stderr: 43950K .......... .......... .......... .......... .......... 59% 271M 0s 2019-11-25T09:39:52.877 INFO:teuthology.orchestra.run.smithi135.stderr: 44000K .......... .......... .......... .......... .......... 59% 278M 0s 2019-11-25T09:39:52.877 INFO:teuthology.orchestra.run.smithi135.stderr: 44050K .......... .......... .......... .......... .......... 59% 303M 0s 2019-11-25T09:39:52.877 INFO:teuthology.orchestra.run.smithi135.stderr: 44100K .......... .......... .......... .......... .......... 60% 307M 0s 2019-11-25T09:39:52.877 INFO:teuthology.orchestra.run.smithi135.stderr: 44150K .......... .......... .......... .......... .......... 60% 236M 0s 2019-11-25T09:39:52.878 INFO:teuthology.orchestra.run.smithi135.stderr: 44200K .......... .......... .......... .......... .......... 60% 294M 0s 2019-11-25T09:39:52.878 INFO:teuthology.orchestra.run.smithi135.stderr: 44250K .......... .......... .......... .......... .......... 60% 256M 0s 2019-11-25T09:39:52.878 INFO:teuthology.orchestra.run.smithi135.stderr: 44300K .......... .......... .......... .......... .......... 60% 282M 0s 2019-11-25T09:39:52.878 INFO:teuthology.orchestra.run.smithi135.stderr: 44350K .......... .......... .......... .......... .......... 60% 181M 0s 2019-11-25T09:39:52.878 INFO:teuthology.orchestra.run.smithi135.stderr: 44400K .......... .......... .......... .......... .......... 60% 272M 0s 2019-11-25T09:39:52.878 INFO:teuthology.orchestra.run.smithi135.stderr: 44450K .......... .......... .......... .......... .......... 60% 277M 0s 2019-11-25T09:39:52.878 INFO:teuthology.orchestra.run.smithi135.stderr: 44500K .......... .......... .......... .......... .......... 60% 276M 0s 2019-11-25T09:39:52.879 INFO:teuthology.orchestra.run.smithi135.stderr: 44550K .......... .......... .......... .......... .......... 60% 245M 0s 2019-11-25T09:39:52.879 INFO:teuthology.orchestra.run.smithi135.stderr: 44600K .......... .......... .......... .......... .......... 60% 295M 0s 2019-11-25T09:39:52.879 INFO:teuthology.orchestra.run.smithi135.stderr: 44650K .......... .......... .......... .......... .......... 60% 266M 0s 2019-11-25T09:39:52.879 INFO:teuthology.orchestra.run.smithi135.stderr: 44700K .......... .......... .......... .......... .......... 60% 294M 0s 2019-11-25T09:39:52.879 INFO:teuthology.orchestra.run.smithi135.stderr: 44750K .......... .......... .......... .......... .......... 60% 232M 0s 2019-11-25T09:39:52.879 INFO:teuthology.orchestra.run.smithi135.stderr: 44800K .......... .......... .......... .......... .......... 60% 269M 0s 2019-11-25T09:39:52.879 INFO:teuthology.orchestra.run.smithi135.stderr: 44850K .......... .......... .......... .......... .......... 61% 289M 0s 2019-11-25T09:39:52.879 INFO:teuthology.orchestra.run.smithi135.stderr: 44900K .......... .......... .......... .......... .......... 61% 299M 0s 2019-11-25T09:39:52.880 INFO:teuthology.orchestra.run.smithi135.stderr: 44950K .......... .......... .......... .......... .......... 61% 245M 0s 2019-11-25T09:39:52.880 INFO:teuthology.orchestra.run.smithi135.stderr: 45000K .......... .......... .......... .......... .......... 61% 289M 0s 2019-11-25T09:39:52.880 INFO:teuthology.orchestra.run.smithi135.stderr: 45050K .......... .......... .......... .......... .......... 61% 299M 0s 2019-11-25T09:39:52.880 INFO:teuthology.orchestra.run.smithi135.stderr: 45100K .......... .......... .......... .......... .......... 61% 291M 0s 2019-11-25T09:39:52.880 INFO:teuthology.orchestra.run.smithi135.stderr: 45150K .......... .......... .......... .......... .......... 61% 256M 0s 2019-11-25T09:39:52.880 INFO:teuthology.orchestra.run.smithi135.stderr: 45200K .......... .......... .......... .......... .......... 61% 288M 0s 2019-11-25T09:39:52.880 INFO:teuthology.orchestra.run.smithi135.stderr: 45250K .......... .......... .......... .......... .......... 61% 295M 0s 2019-11-25T09:39:52.881 INFO:teuthology.orchestra.run.smithi135.stderr: 45300K .......... .......... .......... .......... .......... 61% 315M 0s 2019-11-25T09:39:52.881 INFO:teuthology.orchestra.run.smithi135.stderr: 45350K .......... .......... .......... .......... .......... 61% 236M 0s 2019-11-25T09:39:52.881 INFO:teuthology.orchestra.run.smithi135.stderr: 45400K .......... .......... .......... .......... .......... 61% 287M 0s 2019-11-25T09:39:52.881 INFO:teuthology.orchestra.run.smithi135.stderr: 45450K .......... .......... .......... .......... .......... 61% 300M 0s 2019-11-25T09:39:52.881 INFO:teuthology.orchestra.run.smithi135.stderr: 45500K .......... .......... .......... .......... .......... 61% 285M 0s 2019-11-25T09:39:52.881 INFO:teuthology.orchestra.run.smithi135.stderr: 45550K .......... .......... .......... .......... .......... 61% 203M 0s 2019-11-25T09:39:52.881 INFO:teuthology.orchestra.run.smithi135.stderr: 45600K .......... .......... .......... .......... .......... 62% 252M 0s 2019-11-25T09:39:52.882 INFO:teuthology.orchestra.run.smithi135.stderr: 45650K .......... .......... .......... .......... .......... 62% 297M 0s 2019-11-25T09:39:52.882 INFO:teuthology.orchestra.run.smithi135.stderr: 45700K .......... .......... .......... .......... .......... 62% 299M 0s 2019-11-25T09:39:52.882 INFO:teuthology.orchestra.run.smithi135.stderr: 45750K .......... .......... .......... .......... .......... 62% 242M 0s 2019-11-25T09:39:52.882 INFO:teuthology.orchestra.run.smithi135.stderr: 45800K .......... .......... .......... .......... .......... 62% 303M 0s 2019-11-25T09:39:52.882 INFO:teuthology.orchestra.run.smithi135.stderr: 45850K .......... .......... .......... .......... .......... 62% 296M 0s 2019-11-25T09:39:52.882 INFO:teuthology.orchestra.run.smithi135.stderr: 45900K .......... .......... .......... .......... .......... 62% 290M 0s 2019-11-25T09:39:52.882 INFO:teuthology.orchestra.run.smithi135.stderr: 45950K .......... .......... .......... .......... .......... 62% 257M 0s 2019-11-25T09:39:52.883 INFO:teuthology.orchestra.run.smithi135.stderr: 46000K .......... .......... .......... .......... .......... 62% 307M 0s 2019-11-25T09:39:52.883 INFO:teuthology.orchestra.run.smithi135.stderr: 46050K .......... .......... .......... .......... .......... 62% 274M 0s 2019-11-25T09:39:52.883 INFO:teuthology.orchestra.run.smithi135.stderr: 46100K .......... .......... .......... .......... .......... 62% 284M 0s 2019-11-25T09:39:52.883 INFO:teuthology.orchestra.run.smithi135.stderr: 46150K .......... .......... .......... .......... .......... 62% 261M 0s 2019-11-25T09:39:52.883 INFO:teuthology.orchestra.run.smithi135.stderr: 46200K .......... .......... .......... .......... .......... 62% 298M 0s 2019-11-25T09:39:52.883 INFO:teuthology.orchestra.run.smithi135.stderr: 46250K .......... .......... .......... .......... .......... 62% 312M 0s 2019-11-25T09:39:52.883 INFO:teuthology.orchestra.run.smithi135.stderr: 46300K .......... .......... .......... .......... .......... 63% 341M 0s 2019-11-25T09:39:52.884 INFO:teuthology.orchestra.run.smithi135.stderr: 46350K .......... .......... .......... .......... .......... 63% 277M 0s 2019-11-25T09:39:52.884 INFO:teuthology.orchestra.run.smithi135.stderr: 46400K .......... .......... .......... .......... .......... 63% 255M 0s 2019-11-25T09:39:52.884 INFO:teuthology.orchestra.run.smithi135.stderr: 46450K .......... .......... .......... .......... .......... 63% 255M 0s 2019-11-25T09:39:52.884 INFO:teuthology.orchestra.run.smithi135.stderr: 46500K .......... .......... .......... .......... .......... 63% 219M 0s 2019-11-25T09:39:52.884 INFO:teuthology.orchestra.run.smithi135.stderr: 46550K .......... .......... .......... .......... .......... 63% 216M 0s 2019-11-25T09:39:52.884 INFO:teuthology.orchestra.run.smithi135.stderr: 46600K .......... .......... .......... .......... .......... 63% 220M 0s 2019-11-25T09:39:52.884 INFO:teuthology.orchestra.run.smithi135.stderr: 46650K .......... .......... .......... .......... .......... 63% 240M 0s 2019-11-25T09:39:52.885 INFO:teuthology.orchestra.run.smithi135.stderr: 46700K .......... .......... .......... .......... .......... 63% 256M 0s 2019-11-25T09:39:52.885 INFO:teuthology.orchestra.run.smithi135.stderr: 46750K .......... .......... .......... .......... .......... 63% 226M 0s 2019-11-25T09:39:52.885 INFO:teuthology.orchestra.run.smithi135.stderr: 46800K .......... .......... .......... .......... .......... 63% 287M 0s 2019-11-25T09:39:52.885 INFO:teuthology.orchestra.run.smithi135.stderr: 46850K .......... .......... .......... .......... .......... 63% 289M 0s 2019-11-25T09:39:52.885 INFO:teuthology.orchestra.run.smithi135.stderr: 46900K .......... .......... .......... .......... .......... 63% 248M 0s 2019-11-25T09:39:52.885 INFO:teuthology.orchestra.run.smithi135.stderr: 46950K .......... .......... .......... .......... .......... 63% 154M 0s 2019-11-25T09:39:52.885 INFO:teuthology.orchestra.run.smithi135.stderr: 47000K .......... .......... .......... .......... .......... 63% 240M 0s 2019-11-25T09:39:52.886 INFO:teuthology.orchestra.run.smithi135.stderr: 47050K .......... .......... .......... .......... .......... 64% 402M 0s 2019-11-25T09:39:52.886 INFO:teuthology.orchestra.run.smithi135.stderr: 47100K .......... .......... .......... .......... .......... 64% 343M 0s 2019-11-25T09:39:52.886 INFO:teuthology.orchestra.run.smithi135.stderr: 47150K .......... .......... .......... .......... .......... 64% 362M 0s 2019-11-25T09:39:52.886 INFO:teuthology.orchestra.run.smithi135.stderr: 47200K .......... .......... .......... .......... .......... 64% 308M 0s 2019-11-25T09:39:52.886 INFO:teuthology.orchestra.run.smithi135.stderr: 47250K .......... .......... .......... .......... .......... 64% 265M 0s 2019-11-25T09:39:52.886 INFO:teuthology.orchestra.run.smithi135.stderr: 47300K .......... .......... .......... .......... .......... 64% 247M 0s 2019-11-25T09:39:52.886 INFO:teuthology.orchestra.run.smithi135.stderr: 47350K .......... .......... .......... .......... .......... 64% 237M 0s 2019-11-25T09:39:52.887 INFO:teuthology.orchestra.run.smithi135.stderr: 47400K .......... .......... .......... .......... .......... 64% 288M 0s 2019-11-25T09:39:52.887 INFO:teuthology.orchestra.run.smithi135.stderr: 47450K .......... .......... .......... .......... .......... 64% 265M 0s 2019-11-25T09:39:52.887 INFO:teuthology.orchestra.run.smithi135.stderr: 47500K .......... .......... .......... .......... .......... 64% 271M 0s 2019-11-25T09:39:52.887 INFO:teuthology.orchestra.run.smithi135.stderr: 47550K .......... .......... .......... .......... .......... 64% 304M 0s 2019-11-25T09:39:52.887 INFO:teuthology.orchestra.run.smithi135.stderr: 47600K .......... .......... .......... .......... .......... 64% 428M 0s 2019-11-25T09:39:52.887 INFO:teuthology.orchestra.run.smithi135.stderr: 47650K .......... .......... .......... .......... .......... 64% 380M 0s 2019-11-25T09:39:52.887 INFO:teuthology.orchestra.run.smithi135.stderr: 47700K .......... .......... .......... .......... .......... 64% 384M 0s 2019-11-25T09:39:52.888 INFO:teuthology.orchestra.run.smithi135.stderr: 47750K .......... .......... .......... .......... .......... 64% 376M 0s 2019-11-25T09:39:52.888 INFO:teuthology.orchestra.run.smithi135.stderr: 47800K .......... .......... .......... .......... .......... 65% 429M 0s 2019-11-25T09:39:52.888 INFO:teuthology.orchestra.run.smithi135.stderr: 47850K .......... .......... .......... .......... .......... 65% 137M 0s 2019-11-25T09:39:52.888 INFO:teuthology.orchestra.run.smithi135.stderr: 47900K .......... .......... .......... .......... .......... 65% 370M 0s 2019-11-25T09:39:52.888 INFO:teuthology.orchestra.run.smithi135.stderr: 47950K .......... .......... .......... .......... .......... 65% 359M 0s 2019-11-25T09:39:52.888 INFO:teuthology.orchestra.run.smithi135.stderr: 48000K .......... .......... .......... .......... .......... 65% 48.7M 0s 2019-11-25T09:39:52.888 INFO:teuthology.orchestra.run.smithi135.stderr: 48050K .......... .......... .......... .......... .......... 65% 392M 0s 2019-11-25T09:39:52.889 INFO:teuthology.orchestra.run.smithi135.stderr: 48100K .......... .......... .......... .......... .......... 65% 363M 0s 2019-11-25T09:39:52.889 INFO:teuthology.orchestra.run.smithi135.stderr: 48150K .......... .......... .......... .......... .......... 65% 56.0M 0s 2019-11-25T09:39:52.889 INFO:teuthology.orchestra.run.smithi135.stderr: 48200K .......... .......... .......... .......... .......... 65% 402M 0s 2019-11-25T09:39:52.889 INFO:teuthology.orchestra.run.smithi135.stderr: 48250K .......... .......... .......... .......... .......... 65% 415M 0s 2019-11-25T09:39:52.889 INFO:teuthology.orchestra.run.smithi135.stderr: 48300K .......... .......... .......... .......... .......... 65% 24.3M 0s 2019-11-25T09:39:52.889 INFO:teuthology.orchestra.run.smithi135.stderr: 48350K .......... .......... .......... .......... .......... 65% 239M 0s 2019-11-25T09:39:52.889 INFO:teuthology.orchestra.run.smithi135.stderr: 48400K .......... .......... .......... .......... .......... 65% 326M 0s 2019-11-25T09:39:52.890 INFO:teuthology.orchestra.run.smithi135.stderr: 48450K .......... .......... .......... .......... .......... 65% 344M 0s 2019-11-25T09:39:52.890 INFO:teuthology.orchestra.run.smithi135.stderr: 48500K .......... .......... .......... .......... .......... 66% 324M 0s 2019-11-25T09:39:52.890 INFO:teuthology.orchestra.run.smithi135.stderr: 48550K .......... .......... .......... .......... .......... 66% 352M 0s 2019-11-25T09:39:52.890 INFO:teuthology.orchestra.run.smithi135.stderr: 48600K .......... .......... .......... .......... .......... 66% 419M 0s 2019-11-25T09:39:52.890 INFO:teuthology.orchestra.run.smithi135.stderr: 48650K .......... .......... .......... .......... .......... 66% 426M 0s 2019-11-25T09:39:52.890 INFO:teuthology.orchestra.run.smithi135.stderr: 48700K .......... .......... .......... .......... .......... 66% 418M 0s 2019-11-25T09:39:52.890 INFO:teuthology.orchestra.run.smithi135.stderr: 48750K .......... .......... .......... .......... .......... 66% 28.9M 0s 2019-11-25T09:39:52.891 INFO:teuthology.orchestra.run.smithi135.stderr: 48800K .......... .......... .......... .......... .......... 66% 340M 0s 2019-11-25T09:39:52.891 INFO:teuthology.orchestra.run.smithi135.stderr: 48850K .......... .......... .......... .......... .......... 66% 374M 0s 2019-11-25T09:39:52.891 INFO:teuthology.orchestra.run.smithi135.stderr: 48900K .......... .......... .......... .......... .......... 66% 377M 0s 2019-11-25T09:39:52.891 INFO:teuthology.orchestra.run.smithi135.stderr: 48950K .......... .......... .......... .......... .......... 66% 284M 0s 2019-11-25T09:39:52.891 INFO:teuthology.orchestra.run.smithi135.stderr: 49000K .......... .......... .......... .......... .......... 66% 301M 0s 2019-11-25T09:39:52.891 INFO:teuthology.orchestra.run.smithi135.stderr: 49050K .......... .......... .......... .......... .......... 66% 294M 0s 2019-11-25T09:39:52.891 INFO:teuthology.orchestra.run.smithi135.stderr: 49100K .......... .......... .......... .......... .......... 66% 26.7M 0s 2019-11-25T09:39:52.892 INFO:teuthology.orchestra.run.smithi135.stderr: 49150K .......... .......... .......... .......... .......... 66% 197M 0s 2019-11-25T09:39:52.892 INFO:teuthology.orchestra.run.smithi135.stderr: 49200K .......... .......... .......... .......... .......... 66% 223M 0s 2019-11-25T09:39:52.892 INFO:teuthology.orchestra.run.smithi135.stderr: 49250K .......... .......... .......... .......... .......... 67% 165M 0s 2019-11-25T09:39:52.892 INFO:teuthology.orchestra.run.smithi135.stderr: 49300K .......... .......... .......... .......... .......... 67% 201M 0s 2019-11-25T09:39:52.892 INFO:teuthology.orchestra.run.smithi135.stderr: 49350K .......... .......... .......... .......... .......... 67% 163M 0s 2019-11-25T09:39:52.892 INFO:teuthology.orchestra.run.smithi135.stderr: 49400K .......... .......... .......... .......... .......... 67% 250M 0s 2019-11-25T09:39:52.892 INFO:teuthology.orchestra.run.smithi135.stderr: 49450K .......... .......... .......... .......... .......... 67% 252M 0s 2019-11-25T09:39:52.893 INFO:teuthology.orchestra.run.smithi135.stderr: 49500K .......... .......... .......... .......... .......... 67% 236M 0s 2019-11-25T09:39:52.893 INFO:teuthology.orchestra.run.smithi135.stderr: 49550K .......... .......... .......... .......... .......... 67% 220M 0s 2019-11-25T09:39:52.893 INFO:teuthology.orchestra.run.smithi135.stderr: 49600K .......... .......... .......... .......... .......... 67% 250M 0s 2019-11-25T09:39:52.893 INFO:teuthology.orchestra.run.smithi135.stderr: 49650K .......... .......... .......... .......... .......... 67% 41.2M 0s 2019-11-25T09:39:52.893 INFO:teuthology.orchestra.run.smithi135.stderr: 49700K .......... .......... .......... .......... .......... 67% 220M 0s 2019-11-25T09:39:52.893 INFO:teuthology.orchestra.run.smithi135.stderr: 49750K .......... .......... .......... .......... .......... 67% 214M 0s 2019-11-25T09:39:52.893 INFO:teuthology.orchestra.run.smithi135.stderr: 49800K .......... .......... .......... .......... .......... 67% 268M 0s 2019-11-25T09:39:52.894 INFO:teuthology.orchestra.run.smithi135.stderr: 49850K .......... .......... .......... .......... .......... 67% 179M 0s 2019-11-25T09:39:52.894 INFO:teuthology.orchestra.run.smithi135.stderr: 49900K .......... .......... .......... .......... .......... 67% 203M 0s 2019-11-25T09:39:52.894 INFO:teuthology.orchestra.run.smithi135.stderr: 49950K .......... .......... .......... .......... .......... 67% 214M 0s 2019-11-25T09:39:52.894 INFO:teuthology.orchestra.run.smithi135.stderr: 50000K .......... .......... .......... .......... .......... 68% 251M 0s 2019-11-25T09:39:52.894 INFO:teuthology.orchestra.run.smithi135.stderr: 50050K .......... .......... .......... .......... .......... 68% 256M 0s 2019-11-25T09:39:52.894 INFO:teuthology.orchestra.run.smithi135.stderr: 50100K .......... .......... .......... .......... .......... 68% 263M 0s 2019-11-25T09:39:52.894 INFO:teuthology.orchestra.run.smithi135.stderr: 50150K .......... .......... .......... .......... .......... 68% 216M 0s 2019-11-25T09:39:52.895 INFO:teuthology.orchestra.run.smithi135.stderr: 50200K .......... .......... .......... .......... .......... 68% 239M 0s 2019-11-25T09:39:52.895 INFO:teuthology.orchestra.run.smithi135.stderr: 50250K .......... .......... .......... .......... .......... 68% 265M 0s 2019-11-25T09:39:52.895 INFO:teuthology.orchestra.run.smithi135.stderr: 50300K .......... .......... .......... .......... .......... 68% 254M 0s 2019-11-25T09:39:52.895 INFO:teuthology.orchestra.run.smithi135.stderr: 50350K .......... .......... .......... .......... .......... 68% 211M 0s 2019-11-25T09:39:52.895 INFO:teuthology.orchestra.run.smithi135.stderr: 50400K .......... .......... .......... .......... .......... 68% 247M 0s 2019-11-25T09:39:52.895 INFO:teuthology.orchestra.run.smithi135.stderr: 50450K .......... .......... .......... .......... .......... 68% 262M 0s 2019-11-25T09:39:52.895 INFO:teuthology.orchestra.run.smithi135.stderr: 50500K .......... .......... .......... .......... .......... 68% 255M 0s 2019-11-25T09:39:52.896 INFO:teuthology.orchestra.run.smithi135.stderr: 50550K .......... .......... .......... .......... .......... 68% 221M 0s 2019-11-25T09:39:52.896 INFO:teuthology.orchestra.run.smithi135.stderr: 50600K .......... .......... .......... .......... .......... 68% 269M 0s 2019-11-25T09:39:52.896 INFO:teuthology.orchestra.run.smithi135.stderr: 50650K .......... .......... .......... .......... .......... 68% 277M 0s 2019-11-25T09:39:52.896 INFO:teuthology.orchestra.run.smithi135.stderr: 50700K .......... .......... .......... .......... .......... 68% 241M 0s 2019-11-25T09:39:52.896 INFO:teuthology.orchestra.run.smithi135.stderr: 50750K .......... .......... .......... .......... .......... 69% 201M 0s 2019-11-25T09:39:52.896 INFO:teuthology.orchestra.run.smithi135.stderr: 50800K .......... .......... .......... .......... .......... 69% 164M 0s 2019-11-25T09:39:52.896 INFO:teuthology.orchestra.run.smithi135.stderr: 50850K .......... .......... .......... .......... .......... 69% 234M 0s 2019-11-25T09:39:52.897 INFO:teuthology.orchestra.run.smithi135.stderr: 50900K .......... .......... .......... .......... .......... 69% 215M 0s 2019-11-25T09:39:52.897 INFO:teuthology.orchestra.run.smithi135.stderr: 50950K .......... .......... .......... .......... .......... 69% 231M 0s 2019-11-25T09:39:52.897 INFO:teuthology.orchestra.run.smithi135.stderr: 51000K .......... .......... .......... .......... .......... 69% 243M 0s 2019-11-25T09:39:52.897 INFO:teuthology.orchestra.run.smithi135.stderr: 51050K .......... .......... .......... .......... .......... 69% 270M 0s 2019-11-25T09:39:52.897 INFO:teuthology.orchestra.run.smithi135.stderr: 51100K .......... .......... .......... .......... .......... 69% 255M 0s 2019-11-25T09:39:52.897 INFO:teuthology.orchestra.run.smithi135.stderr: 51150K .......... .......... .......... .......... .......... 69% 228M 0s 2019-11-25T09:39:52.898 INFO:teuthology.orchestra.run.smithi135.stderr: 51200K .......... .......... .......... .......... .......... 69% 222M 0s 2019-11-25T09:39:52.898 INFO:teuthology.orchestra.run.smithi135.stderr: 51250K .......... .......... .......... .......... .......... 69% 252M 0s 2019-11-25T09:39:52.898 INFO:teuthology.orchestra.run.smithi135.stderr: 51300K .......... .......... .......... .......... .......... 69% 21.0M 0s 2019-11-25T09:39:52.898 INFO:teuthology.orchestra.run.smithi135.stderr: 51350K .......... .......... .......... .......... .......... 69% 225M 0s 2019-11-25T09:39:52.898 INFO:teuthology.orchestra.run.smithi135.stderr: 51400K .......... .......... .......... .......... .......... 69% 348M 0s 2019-11-25T09:39:52.898 INFO:teuthology.orchestra.run.smithi135.stderr: 51450K .......... .......... .......... .......... .......... 70% 286M 0s 2019-11-25T09:39:52.898 INFO:teuthology.orchestra.run.smithi135.stderr: 51500K .......... .......... .......... .......... .......... 70% 322M 0s 2019-11-25T09:39:52.899 INFO:teuthology.orchestra.run.smithi135.stderr: 51550K .......... .......... .......... .......... .......... 70% 328M 0s 2019-11-25T09:39:52.899 INFO:teuthology.orchestra.run.smithi135.stderr: 51600K .......... .......... .......... .......... .......... 70% 396M 0s 2019-11-25T09:39:52.899 INFO:teuthology.orchestra.run.smithi135.stderr: 51650K .......... .......... .......... .......... .......... 70% 386M 0s 2019-11-25T09:39:52.899 INFO:teuthology.orchestra.run.smithi135.stderr: 51700K .......... .......... .......... .......... .......... 70% 399M 0s 2019-11-25T09:39:52.899 INFO:teuthology.orchestra.run.smithi135.stderr: 51750K .......... .......... .......... .......... .......... 70% 353M 0s 2019-11-25T09:39:52.899 INFO:teuthology.orchestra.run.smithi135.stderr: 51800K .......... .......... .......... .......... .......... 70% 293M 0s 2019-11-25T09:39:52.899 INFO:teuthology.orchestra.run.smithi135.stderr: 51850K .......... .......... .......... .......... .......... 70% 313M 0s 2019-11-25T09:39:52.900 INFO:teuthology.orchestra.run.smithi135.stderr: 51900K .......... .......... .......... .......... .......... 70% 408M 0s 2019-11-25T09:39:52.900 INFO:teuthology.orchestra.run.smithi135.stderr: 51950K .......... .......... .......... .......... .......... 70% 323M 0s 2019-11-25T09:39:52.900 INFO:teuthology.orchestra.run.smithi135.stderr: 52000K .......... .......... .......... .......... .......... 70% 385M 0s 2019-11-25T09:39:52.900 INFO:teuthology.orchestra.run.smithi135.stderr: 52050K .......... .......... .......... .......... .......... 70% 362M 0s 2019-11-25T09:39:52.900 INFO:teuthology.orchestra.run.smithi135.stderr: 52100K .......... .......... .......... .......... .......... 70% 398M 0s 2019-11-25T09:39:52.900 INFO:teuthology.orchestra.run.smithi135.stderr: 52150K .......... .......... .......... .......... .......... 70% 357M 0s 2019-11-25T09:39:52.900 INFO:teuthology.orchestra.run.smithi135.stderr: 52200K .......... .......... .......... .......... .......... 71% 403M 0s 2019-11-25T09:39:52.901 INFO:teuthology.orchestra.run.smithi135.stderr: 52250K .......... .......... .......... .......... .......... 71% 393M 0s 2019-11-25T09:39:52.901 INFO:teuthology.orchestra.run.smithi135.stderr: 52300K .......... .......... .......... .......... .......... 71% 419M 0s 2019-11-25T09:39:52.901 INFO:teuthology.orchestra.run.smithi135.stderr: 52350K .......... .......... .......... .......... .......... 71% 307M 0s 2019-11-25T09:39:52.901 INFO:teuthology.orchestra.run.smithi135.stderr: 52400K .......... .......... .......... .......... .......... 71% 415M 0s 2019-11-25T09:39:52.901 INFO:teuthology.orchestra.run.smithi135.stderr: 52450K .......... .......... .......... .......... .......... 71% 398M 0s 2019-11-25T09:39:52.901 INFO:teuthology.orchestra.run.smithi135.stderr: 52500K .......... .......... .......... .......... .......... 71% 395M 0s 2019-11-25T09:39:52.901 INFO:teuthology.orchestra.run.smithi135.stderr: 52550K .......... .......... .......... .......... .......... 71% 340M 0s 2019-11-25T09:39:52.902 INFO:teuthology.orchestra.run.smithi135.stderr: 52600K .......... .......... .......... .......... .......... 71% 438M 0s 2019-11-25T09:39:52.902 INFO:teuthology.orchestra.run.smithi135.stderr: 52650K .......... .......... .......... .......... .......... 71% 420M 0s 2019-11-25T09:39:52.902 INFO:teuthology.orchestra.run.smithi135.stderr: 52700K .......... .......... .......... .......... .......... 71% 403M 0s 2019-11-25T09:39:52.902 INFO:teuthology.orchestra.run.smithi135.stderr: 52750K .......... .......... .......... .......... .......... 71% 57.9M 0s 2019-11-25T09:39:52.902 INFO:teuthology.orchestra.run.smithi135.stderr: 52800K .......... .......... .......... .......... .......... 71% 205M 0s 2019-11-25T09:39:52.902 INFO:teuthology.orchestra.run.smithi135.stderr: 52850K .......... .......... .......... .......... .......... 71% 280M 0s 2019-11-25T09:39:52.902 INFO:teuthology.orchestra.run.smithi135.stderr: 52900K .......... .......... .......... .......... .......... 71% 269M 0s 2019-11-25T09:39:52.903 INFO:teuthology.orchestra.run.smithi135.stderr: 52950K .......... .......... .......... .......... .......... 72% 165M 0s 2019-11-25T09:39:52.903 INFO:teuthology.orchestra.run.smithi135.stderr: 53000K .......... .......... .......... .......... .......... 72% 204M 0s 2019-11-25T09:39:52.903 INFO:teuthology.orchestra.run.smithi135.stderr: 53050K .......... .......... .......... .......... .......... 72% 192M 0s 2019-11-25T09:39:52.903 INFO:teuthology.orchestra.run.smithi135.stderr: 53100K .......... .......... .......... .......... .......... 72% 256M 0s 2019-11-25T09:39:52.903 INFO:teuthology.orchestra.run.smithi135.stderr: 53150K .......... .......... .......... .......... .......... 72% 168M 0s 2019-11-25T09:39:52.903 INFO:teuthology.orchestra.run.smithi135.stderr: 53200K .......... .......... .......... .......... .......... 72% 203M 0s 2019-11-25T09:39:52.904 INFO:teuthology.orchestra.run.smithi135.stderr: 53250K .......... .......... .......... .......... .......... 72% 221M 0s 2019-11-25T09:39:52.904 INFO:teuthology.orchestra.run.smithi135.stderr: 53300K .......... .......... .......... .......... .......... 72% 296M 0s 2019-11-25T09:39:52.904 INFO:teuthology.orchestra.run.smithi135.stderr: 53350K .......... .......... .......... .......... .......... 72% 242M 0s 2019-11-25T09:39:52.904 INFO:teuthology.orchestra.run.smithi135.stderr: 53400K .......... .......... .......... .......... .......... 72% 260M 0s 2019-11-25T09:39:52.904 INFO:teuthology.orchestra.run.smithi135.stderr: 53450K .......... .......... .......... .......... .......... 72% 230M 0s 2019-11-25T09:39:52.904 INFO:teuthology.orchestra.run.smithi135.stderr: 53500K .......... .......... .......... .......... .......... 72% 214M 0s 2019-11-25T09:39:52.904 INFO:teuthology.orchestra.run.smithi135.stderr: 53550K .......... .......... .......... .......... .......... 72% 205M 0s 2019-11-25T09:39:52.905 INFO:teuthology.orchestra.run.smithi135.stderr: 53600K .......... .......... .......... .......... .......... 72% 220M 0s 2019-11-25T09:39:52.905 INFO:teuthology.orchestra.run.smithi135.stderr: 53650K .......... .......... .......... .......... .......... 73% 234M 0s 2019-11-25T09:39:52.905 INFO:teuthology.orchestra.run.smithi135.stderr: 53700K .......... .......... .......... .......... .......... 73% 129M 0s 2019-11-25T09:39:52.905 INFO:teuthology.orchestra.run.smithi135.stderr: 53750K .......... .......... .......... .......... .......... 73% 69.1M 0s 2019-11-25T09:39:52.905 INFO:teuthology.orchestra.run.smithi135.stderr: 53800K .......... .......... .......... .......... .......... 73% 236M 0s 2019-11-25T09:39:52.905 INFO:teuthology.orchestra.run.smithi135.stderr: 53850K .......... .......... .......... .......... .......... 73% 83.7M 0s 2019-11-25T09:39:52.905 INFO:teuthology.orchestra.run.smithi135.stderr: 53900K .......... .......... .......... .......... .......... 73% 203M 0s 2019-11-25T09:39:52.906 INFO:teuthology.orchestra.run.smithi135.stderr: 53950K .......... .......... .......... .......... .......... 73% 214M 0s 2019-11-25T09:39:52.906 INFO:teuthology.orchestra.run.smithi135.stderr: 54000K .......... .......... .......... .......... .......... 73% 63.8M 0s 2019-11-25T09:39:52.906 INFO:teuthology.orchestra.run.smithi135.stderr: 54050K .......... .......... .......... .......... .......... 73% 220M 0s 2019-11-25T09:39:52.906 INFO:teuthology.orchestra.run.smithi135.stderr: 54100K .......... .......... .......... .......... .......... 73% 229M 0s 2019-11-25T09:39:52.906 INFO:teuthology.orchestra.run.smithi135.stderr: 54150K .......... .......... .......... .......... .......... 73% 169M 0s 2019-11-25T09:39:52.906 INFO:teuthology.orchestra.run.smithi135.stderr: 54200K .......... .......... .......... .......... .......... 73% 330M 0s 2019-11-25T09:39:52.906 INFO:teuthology.orchestra.run.smithi135.stderr: 54250K .......... .......... .......... .......... .......... 73% 61.3M 0s 2019-11-25T09:39:52.907 INFO:teuthology.orchestra.run.smithi135.stderr: 54300K .......... .......... .......... .......... .......... 73% 284M 0s 2019-11-25T09:39:52.907 INFO:teuthology.orchestra.run.smithi135.stderr: 54350K .......... .......... .......... .......... .......... 73% 165M 0s 2019-11-25T09:39:52.907 INFO:teuthology.orchestra.run.smithi135.stderr: 54400K .......... .......... .......... .......... .......... 74% 242M 0s 2019-11-25T09:39:52.907 INFO:teuthology.orchestra.run.smithi135.stderr: 54450K .......... .......... .......... .......... .......... 74% 237M 0s 2019-11-25T09:39:52.907 INFO:teuthology.orchestra.run.smithi135.stderr: 54500K .......... .......... .......... .......... .......... 74% 243M 0s 2019-11-25T09:39:52.907 INFO:teuthology.orchestra.run.smithi135.stderr: 54550K .......... .......... .......... .......... .......... 74% 102M 0s 2019-11-25T09:39:52.907 INFO:teuthology.orchestra.run.smithi135.stderr: 54600K .......... .......... .......... .......... .......... 74% 103M 0s 2019-11-25T09:39:52.908 INFO:teuthology.orchestra.run.smithi135.stderr: 54650K .......... .......... .......... .......... .......... 74% 317M 0s 2019-11-25T09:39:52.908 INFO:teuthology.orchestra.run.smithi135.stderr: 54700K .......... .......... .......... .......... .......... 74% 356M 0s 2019-11-25T09:39:52.908 INFO:teuthology.orchestra.run.smithi135.stderr: 54750K .......... .......... .......... .......... .......... 74% 380M 0s 2019-11-25T09:39:52.908 INFO:teuthology.orchestra.run.smithi135.stderr: 54800K .......... .......... .......... .......... .......... 74% 101M 0s 2019-11-25T09:39:52.908 INFO:teuthology.orchestra.run.smithi135.stderr: 54850K .......... .......... .......... .......... .......... 74% 402M 0s 2019-11-25T09:39:52.908 INFO:teuthology.orchestra.run.smithi135.stderr: 54900K .......... .......... .......... .......... .......... 74% 128M 0s 2019-11-25T09:39:52.909 INFO:teuthology.orchestra.run.smithi135.stderr: 54950K .......... .......... .......... .......... .......... 74% 361M 0s 2019-11-25T09:39:52.909 INFO:teuthology.orchestra.run.smithi135.stderr: 55000K .......... .......... .......... .......... .......... 74% 160M 0s 2019-11-25T09:39:52.909 INFO:teuthology.orchestra.run.smithi135.stderr: 55050K .......... .......... .......... .......... .......... 74% 84.8M 0s 2019-11-25T09:39:52.909 INFO:teuthology.orchestra.run.smithi135.stderr: 55100K .......... .......... .......... .......... .......... 74% 314M 0s 2019-11-25T09:39:52.909 INFO:teuthology.orchestra.run.smithi135.stderr: 55150K .......... .......... .......... .......... .......... 75% 73.2M 0s 2019-11-25T09:39:52.909 INFO:teuthology.orchestra.run.smithi135.stderr: 55200K .......... .......... .......... .......... .......... 75% 272M 0s 2019-11-25T09:39:52.909 INFO:teuthology.orchestra.run.smithi135.stderr: 55250K .......... .......... .......... .......... .......... 75% 307M 0s 2019-11-25T09:39:52.910 INFO:teuthology.orchestra.run.smithi135.stderr: 55300K .......... .......... .......... .......... .......... 75% 141M 0s 2019-11-25T09:39:52.910 INFO:teuthology.orchestra.run.smithi135.stderr: 55350K .......... .......... .......... .......... .......... 75% 264M 0s 2019-11-25T09:39:52.910 INFO:teuthology.orchestra.run.smithi135.stderr: 55400K .......... .......... .......... .......... .......... 75% 69.6M 0s 2019-11-25T09:39:52.910 INFO:teuthology.orchestra.run.smithi135.stderr: 55450K .......... .......... .......... .......... .......... 75% 281M 0s 2019-11-25T09:39:52.910 INFO:teuthology.orchestra.run.smithi135.stderr: 55500K .......... .......... .......... .......... .......... 75% 400M 0s 2019-11-25T09:39:52.910 INFO:teuthology.orchestra.run.smithi135.stderr: 55550K .......... .......... .......... .......... .......... 75% 339M 0s 2019-11-25T09:39:52.910 INFO:teuthology.orchestra.run.smithi135.stderr: 55600K .......... .......... .......... .......... .......... 75% 21.6M 0s 2019-11-25T09:39:52.911 INFO:teuthology.orchestra.run.smithi135.stderr: 55650K .......... .......... .......... .......... .......... 75% 228M 0s 2019-11-25T09:39:52.911 INFO:teuthology.orchestra.run.smithi135.stderr: 55700K .......... .......... .......... .......... .......... 75% 215M 0s 2019-11-25T09:39:52.911 INFO:teuthology.orchestra.run.smithi135.stderr: 55750K .......... .......... .......... .......... .......... 75% 219M 0s 2019-11-25T09:39:52.911 INFO:teuthology.orchestra.run.smithi135.stderr: 55800K .......... .......... .......... .......... .......... 75% 288M 0s 2019-11-25T09:39:52.911 INFO:teuthology.orchestra.run.smithi135.stderr: 55850K .......... .......... .......... .......... .......... 75% 245M 0s 2019-11-25T09:39:52.911 INFO:teuthology.orchestra.run.smithi135.stderr: 55900K .......... .......... .......... .......... .......... 76% 248M 0s 2019-11-25T09:39:52.911 INFO:teuthology.orchestra.run.smithi135.stderr: 55950K .......... .......... .......... .......... .......... 76% 234M 0s 2019-11-25T09:39:52.912 INFO:teuthology.orchestra.run.smithi135.stderr: 56000K .......... .......... .......... .......... .......... 76% 316M 0s 2019-11-25T09:39:52.912 INFO:teuthology.orchestra.run.smithi135.stderr: 56050K .......... .......... .......... .......... .......... 76% 313M 0s 2019-11-25T09:39:52.912 INFO:teuthology.orchestra.run.smithi135.stderr: 56100K .......... .......... .......... .......... .......... 76% 315M 0s 2019-11-25T09:39:52.912 INFO:teuthology.orchestra.run.smithi135.stderr: 56150K .......... .......... .......... .......... .......... 76% 290M 0s 2019-11-25T09:39:52.912 INFO:teuthology.orchestra.run.smithi135.stderr: 56200K .......... .......... .......... .......... .......... 76% 312M 0s 2019-11-25T09:39:52.912 INFO:teuthology.orchestra.run.smithi135.stderr: 56250K .......... .......... .......... .......... .......... 76% 310M 0s 2019-11-25T09:39:52.912 INFO:teuthology.orchestra.run.smithi135.stderr: 56300K .......... .......... .......... .......... .......... 76% 42.7M 0s 2019-11-25T09:39:52.913 INFO:teuthology.orchestra.run.smithi135.stderr: 56350K .......... .......... .......... .......... .......... 76% 197M 0s 2019-11-25T09:39:52.913 INFO:teuthology.orchestra.run.smithi135.stderr: 56400K .......... .......... .......... .......... .......... 76% 240M 0s 2019-11-25T09:39:52.913 INFO:teuthology.orchestra.run.smithi135.stderr: 56450K .......... .......... .......... .......... .......... 76% 274M 0s 2019-11-25T09:39:52.913 INFO:teuthology.orchestra.run.smithi135.stderr: 56500K .......... .......... .......... .......... .......... 76% 284M 0s 2019-11-25T09:39:52.913 INFO:teuthology.orchestra.run.smithi135.stderr: 56550K .......... .......... .......... .......... .......... 76% 257M 0s 2019-11-25T09:39:52.913 INFO:teuthology.orchestra.run.smithi135.stderr: 56600K .......... .......... .......... .......... .......... 77% 287M 0s 2019-11-25T09:39:52.914 INFO:teuthology.orchestra.run.smithi135.stderr: 56650K .......... .......... .......... .......... .......... 77% 285M 0s 2019-11-25T09:39:52.914 INFO:teuthology.orchestra.run.smithi135.stderr: 56700K .......... .......... .......... .......... .......... 77% 283M 0s 2019-11-25T09:39:52.914 INFO:teuthology.orchestra.run.smithi135.stderr: 56750K .......... .......... .......... .......... .......... 77% 235M 0s 2019-11-25T09:39:52.914 INFO:teuthology.orchestra.run.smithi135.stderr: 56800K .......... .......... .......... .......... .......... 77% 273M 0s 2019-11-25T09:39:52.914 INFO:teuthology.orchestra.run.smithi135.stderr: 56850K .......... .......... .......... .......... .......... 77% 285M 0s 2019-11-25T09:39:52.914 INFO:teuthology.orchestra.run.smithi135.stderr: 56900K .......... .......... .......... .......... .......... 77% 299M 0s 2019-11-25T09:39:52.914 INFO:teuthology.orchestra.run.smithi135.stderr: 56950K .......... .......... .......... .......... .......... 77% 263M 0s 2019-11-25T09:39:52.914 INFO:teuthology.orchestra.run.smithi135.stderr: 57000K .......... .......... .......... .......... .......... 77% 301M 0s 2019-11-25T09:39:52.915 INFO:teuthology.orchestra.run.smithi135.stderr: 57050K .......... .......... .......... .......... .......... 77% 288M 0s 2019-11-25T09:39:52.915 INFO:teuthology.orchestra.run.smithi135.stderr: 57100K .......... .......... .......... .......... .......... 77% 296M 0s 2019-11-25T09:39:52.915 INFO:teuthology.orchestra.run.smithi135.stderr: 57150K .......... .......... .......... .......... .......... 77% 250M 0s 2019-11-25T09:39:52.915 INFO:teuthology.orchestra.run.smithi135.stderr: 57200K .......... .......... .......... .......... .......... 77% 299M 0s 2019-11-25T09:39:52.915 INFO:teuthology.orchestra.run.smithi135.stderr: 57250K .......... .......... .......... .......... .......... 77% 300M 0s 2019-11-25T09:39:52.915 INFO:teuthology.orchestra.run.smithi135.stderr: 57300K .......... .......... .......... .......... .......... 77% 290M 0s 2019-11-25T09:39:52.915 INFO:teuthology.orchestra.run.smithi135.stderr: 57350K .......... .......... .......... .......... .......... 78% 263M 0s 2019-11-25T09:39:52.916 INFO:teuthology.orchestra.run.smithi135.stderr: 57400K .......... .......... .......... .......... .......... 78% 283M 0s 2019-11-25T09:39:52.916 INFO:teuthology.orchestra.run.smithi135.stderr: 57450K .......... .......... .......... .......... .......... 78% 264M 0s 2019-11-25T09:39:52.916 INFO:teuthology.orchestra.run.smithi135.stderr: 57500K .......... .......... .......... .......... .......... 78% 276M 0s 2019-11-25T09:39:52.916 INFO:teuthology.orchestra.run.smithi135.stderr: 57550K .......... .......... .......... .......... .......... 78% 261M 0s 2019-11-25T09:39:52.916 INFO:teuthology.orchestra.run.smithi135.stderr: 57600K .......... .......... .......... .......... .......... 78% 296M 0s 2019-11-25T09:39:52.916 INFO:teuthology.orchestra.run.smithi135.stderr: 57650K .......... .......... .......... .......... .......... 78% 305M 0s 2019-11-25T09:39:52.917 INFO:teuthology.orchestra.run.smithi135.stderr: 57700K .......... .......... .......... .......... .......... 78% 295M 0s 2019-11-25T09:39:52.917 INFO:teuthology.orchestra.run.smithi135.stderr: 57750K .......... .......... .......... .......... .......... 78% 267M 0s 2019-11-25T09:39:52.917 INFO:teuthology.orchestra.run.smithi135.stderr: 57800K .......... .......... .......... .......... .......... 78% 304M 0s 2019-11-25T09:39:52.917 INFO:teuthology.orchestra.run.smithi135.stderr: 57850K .......... .......... .......... .......... .......... 78% 301M 0s 2019-11-25T09:39:52.917 INFO:teuthology.orchestra.run.smithi135.stderr: 57900K .......... .......... .......... .......... .......... 78% 299M 0s 2019-11-25T09:39:52.917 INFO:teuthology.orchestra.run.smithi135.stderr: 57950K .......... .......... .......... .......... .......... 78% 270M 0s 2019-11-25T09:39:52.917 INFO:teuthology.orchestra.run.smithi135.stderr: 58000K .......... .......... .......... .......... .......... 78% 272M 0s 2019-11-25T09:39:52.918 INFO:teuthology.orchestra.run.smithi135.stderr: 58050K .......... .......... .......... .......... .......... 78% 277M 0s 2019-11-25T09:39:52.918 INFO:teuthology.orchestra.run.smithi135.stderr: 58100K .......... .......... .......... .......... .......... 79% 297M 0s 2019-11-25T09:39:52.918 INFO:teuthology.orchestra.run.smithi135.stderr: 58150K .......... .......... .......... .......... .......... 79% 262M 0s 2019-11-25T09:39:52.918 INFO:teuthology.orchestra.run.smithi135.stderr: 58200K .......... .......... .......... .......... .......... 79% 242M 0s 2019-11-25T09:39:52.918 INFO:teuthology.orchestra.run.smithi135.stderr: 58250K .......... .......... .......... .......... .......... 79% 228M 0s 2019-11-25T09:39:52.918 INFO:teuthology.orchestra.run.smithi135.stderr: 58300K .......... .......... .......... .......... .......... 79% 213M 0s 2019-11-25T09:39:52.918 INFO:teuthology.orchestra.run.smithi135.stderr: 58350K .......... .......... .......... .......... .......... 79% 201M 0s 2019-11-25T09:39:52.919 INFO:teuthology.orchestra.run.smithi135.stderr: 58400K .......... .......... .......... .......... .......... 79% 210M 0s 2019-11-25T09:39:52.919 INFO:teuthology.orchestra.run.smithi135.stderr: 58450K .......... .......... .......... .......... .......... 79% 257M 0s 2019-11-25T09:39:52.919 INFO:teuthology.orchestra.run.smithi135.stderr: 58500K .......... .......... .......... .......... .......... 79% 370M 0s 2019-11-25T09:39:52.919 INFO:teuthology.orchestra.run.smithi135.stderr: 58550K .......... .......... .......... .......... .......... 79% 318M 0s 2019-11-25T09:39:52.919 INFO:teuthology.orchestra.run.smithi135.stderr: 58600K .......... .......... .......... .......... .......... 79% 350M 0s 2019-11-25T09:39:52.919 INFO:teuthology.orchestra.run.smithi135.stderr: 58650K .......... .......... .......... .......... .......... 79% 396M 0s 2019-11-25T09:39:52.919 INFO:teuthology.orchestra.run.smithi135.stderr: 58700K .......... .......... .......... .......... .......... 79% 416M 0s 2019-11-25T09:39:52.920 INFO:teuthology.orchestra.run.smithi135.stderr: 58750K .......... .......... .......... .......... .......... 79% 347M 0s 2019-11-25T09:39:52.920 INFO:teuthology.orchestra.run.smithi135.stderr: 58800K .......... .......... .......... .......... .......... 80% 237M 0s 2019-11-25T09:39:52.920 INFO:teuthology.orchestra.run.smithi135.stderr: 58850K .......... .......... .......... .......... .......... 80% 203M 0s 2019-11-25T09:39:52.920 INFO:teuthology.orchestra.run.smithi135.stderr: 58900K .......... .......... .......... .......... .......... 80% 245M 0s 2019-11-25T09:39:52.920 INFO:teuthology.orchestra.run.smithi135.stderr: 58950K .......... .......... .......... .......... .......... 80% 237M 0s 2019-11-25T09:39:52.920 INFO:teuthology.orchestra.run.smithi135.stderr: 59000K .......... .......... .......... .......... .......... 80% 394M 0s 2019-11-25T09:39:52.920 INFO:teuthology.orchestra.run.smithi135.stderr: 59050K .......... .......... .......... .......... .......... 80% 378M 0s 2019-11-25T09:39:52.921 INFO:teuthology.orchestra.run.smithi135.stderr: 59100K .......... .......... .......... .......... .......... 80% 397M 0s 2019-11-25T09:39:52.921 INFO:teuthology.orchestra.run.smithi135.stderr: 59150K .......... .......... .......... .......... .......... 80% 339M 0s 2019-11-25T09:39:52.921 INFO:teuthology.orchestra.run.smithi135.stderr: 59200K .......... .......... .......... .......... .......... 80% 405M 0s 2019-11-25T09:39:52.921 INFO:teuthology.orchestra.run.smithi135.stderr: 59250K .......... .......... .......... .......... .......... 80% 390M 0s 2019-11-25T09:39:52.921 INFO:teuthology.orchestra.run.smithi135.stderr: 59300K .......... .......... .......... .......... .......... 80% 393M 0s 2019-11-25T09:39:52.921 INFO:teuthology.orchestra.run.smithi135.stderr: 59350K .......... .......... .......... .......... .......... 80% 347M 0s 2019-11-25T09:39:52.921 INFO:teuthology.orchestra.run.smithi135.stderr: 59400K .......... .......... .......... .......... .......... 80% 418M 0s 2019-11-25T09:39:52.922 INFO:teuthology.orchestra.run.smithi135.stderr: 59450K .......... .......... .......... .......... .......... 80% 395M 0s 2019-11-25T09:39:52.922 INFO:teuthology.orchestra.run.smithi135.stderr: 59500K .......... .......... .......... .......... .......... 80% 429M 0s 2019-11-25T09:39:52.922 INFO:teuthology.orchestra.run.smithi135.stderr: 59550K .......... .......... .......... .......... .......... 81% 41.5M 0s 2019-11-25T09:39:52.922 INFO:teuthology.orchestra.run.smithi135.stderr: 59600K .......... .......... .......... .......... .......... 81% 380M 0s 2019-11-25T09:39:52.922 INFO:teuthology.orchestra.run.smithi135.stderr: 59650K .......... .......... .......... .......... .......... 81% 347M 0s 2019-11-25T09:39:52.922 INFO:teuthology.orchestra.run.smithi135.stderr: 59700K .......... .......... .......... .......... .......... 81% 317M 0s 2019-11-25T09:39:52.923 INFO:teuthology.orchestra.run.smithi135.stderr: 59750K .......... .......... .......... .......... .......... 81% 281M 0s 2019-11-25T09:39:52.923 INFO:teuthology.orchestra.run.smithi135.stderr: 59800K .......... .......... .......... .......... .......... 81% 226M 0s 2019-11-25T09:39:52.923 INFO:teuthology.orchestra.run.smithi135.stderr: 59850K .......... .......... .......... .......... .......... 81% 217M 0s 2019-11-25T09:39:52.923 INFO:teuthology.orchestra.run.smithi135.stderr: 59900K .......... .......... .......... .......... .......... 81% 180M 0s 2019-11-25T09:39:52.923 INFO:teuthology.orchestra.run.smithi135.stderr: 59950K .......... .......... .......... .......... .......... 81% 214M 0s 2019-11-25T09:39:52.923 INFO:teuthology.orchestra.run.smithi135.stderr: 60000K .......... .......... .......... .......... .......... 81% 217M 0s 2019-11-25T09:39:52.923 INFO:teuthology.orchestra.run.smithi135.stderr: 60050K .......... .......... .......... .......... .......... 81% 233M 0s 2019-11-25T09:39:52.924 INFO:teuthology.orchestra.run.smithi135.stderr: 60100K .......... .......... .......... .......... .......... 81% 233M 0s 2019-11-25T09:39:52.924 INFO:teuthology.orchestra.run.smithi135.stderr: 60150K .......... .......... .......... .......... .......... 81% 93.3M 0s 2019-11-25T09:39:52.924 INFO:teuthology.orchestra.run.smithi135.stderr: 60200K .......... .......... .......... .......... .......... 81% 396M 0s 2019-11-25T09:39:52.924 INFO:teuthology.orchestra.run.smithi135.stderr: 60250K .......... .......... .......... .......... .......... 81% 228M 0s 2019-11-25T09:39:52.924 INFO:teuthology.orchestra.run.smithi135.stderr: 60300K .......... .......... .......... .......... .......... 82% 56.2M 0s 2019-11-25T09:39:52.924 INFO:teuthology.orchestra.run.smithi135.stderr: 60350K .......... .......... .......... .......... .......... 82% 226M 0s 2019-11-25T09:39:52.925 INFO:teuthology.orchestra.run.smithi135.stderr: 60400K .......... .......... .......... .......... .......... 82% 143M 0s 2019-11-25T09:39:52.925 INFO:teuthology.orchestra.run.smithi135.stderr: 60450K .......... .......... .......... .......... .......... 82% 207M 0s 2019-11-25T09:39:52.925 INFO:teuthology.orchestra.run.smithi135.stderr: 60500K .......... .......... .......... .......... .......... 82% 420M 0s 2019-11-25T09:39:52.925 INFO:teuthology.orchestra.run.smithi135.stderr: 60550K .......... .......... .......... .......... .......... 82% 235M 0s 2019-11-25T09:39:52.925 INFO:teuthology.orchestra.run.smithi135.stderr: 60600K .......... .......... .......... .......... .......... 82% 299M 0s 2019-11-25T09:39:52.925 INFO:teuthology.orchestra.run.smithi135.stderr: 60650K .......... .......... .......... .......... .......... 82% 114M 0s 2019-11-25T09:39:52.925 INFO:teuthology.orchestra.run.smithi135.stderr: 60700K .......... .......... .......... .......... .......... 82% 238M 0s 2019-11-25T09:39:52.926 INFO:teuthology.orchestra.run.smithi135.stderr: 60750K .......... .......... .......... .......... .......... 82% 35.2M 0s 2019-11-25T09:39:52.926 INFO:teuthology.orchestra.run.smithi135.stderr: 60800K .......... .......... .......... .......... .......... 82% 313M 0s 2019-11-25T09:39:52.926 INFO:teuthology.orchestra.run.smithi135.stderr: 60850K .......... .......... .......... .......... .......... 82% 296M 0s 2019-11-25T09:39:52.926 INFO:teuthology.orchestra.run.smithi135.stderr: 60900K .......... .......... .......... .......... .......... 82% 296M 0s 2019-11-25T09:39:52.926 INFO:teuthology.orchestra.run.smithi135.stderr: 60950K .......... .......... .......... .......... .......... 82% 212M 0s 2019-11-25T09:39:52.926 INFO:teuthology.orchestra.run.smithi135.stderr: 61000K .......... .......... .......... .......... .......... 82% 233M 0s 2019-11-25T09:39:52.926 INFO:teuthology.orchestra.run.smithi135.stderr: 61050K .......... .......... .......... .......... .......... 83% 226M 0s 2019-11-25T09:39:52.927 INFO:teuthology.orchestra.run.smithi135.stderr: 61100K .......... .......... .......... .......... .......... 83% 260M 0s 2019-11-25T09:39:52.927 INFO:teuthology.orchestra.run.smithi135.stderr: 61150K .......... .......... .......... .......... .......... 83% 239M 0s 2019-11-25T09:39:52.927 INFO:teuthology.orchestra.run.smithi135.stderr: 61200K .......... .......... .......... .......... .......... 83% 238M 0s 2019-11-25T09:39:52.927 INFO:teuthology.orchestra.run.smithi135.stderr: 61250K .......... .......... .......... .......... .......... 83% 244M 0s 2019-11-25T09:39:52.927 INFO:teuthology.orchestra.run.smithi135.stderr: 61300K .......... .......... .......... .......... .......... 83% 239M 0s 2019-11-25T09:39:52.927 INFO:teuthology.orchestra.run.smithi135.stderr: 61350K .......... .......... .......... .......... .......... 83% 212M 0s 2019-11-25T09:39:52.927 INFO:teuthology.orchestra.run.smithi135.stderr: 61400K .......... .......... .......... .......... .......... 83% 317M 0s 2019-11-25T09:39:52.928 INFO:teuthology.orchestra.run.smithi135.stderr: 61450K .......... .......... .......... .......... .......... 83% 282M 0s 2019-11-25T09:39:52.928 INFO:teuthology.orchestra.run.smithi135.stderr: 61500K .......... .......... .......... .......... .......... 83% 257M 0s 2019-11-25T09:39:52.928 INFO:teuthology.orchestra.run.smithi135.stderr: 61550K .......... .......... .......... .......... .......... 83% 291M 0s 2019-11-25T09:39:52.928 INFO:teuthology.orchestra.run.smithi135.stderr: 61600K .......... .......... .......... .......... .......... 83% 314M 0s 2019-11-25T09:39:52.928 INFO:teuthology.orchestra.run.smithi135.stderr: 61650K .......... .......... .......... .......... .......... 83% 351M 0s 2019-11-25T09:39:52.928 INFO:teuthology.orchestra.run.smithi135.stderr: 61700K .......... .......... .......... .......... .......... 83% 304M 0s 2019-11-25T09:39:52.929 INFO:teuthology.orchestra.run.smithi135.stderr: 61750K .......... .......... .......... .......... .......... 84% 284M 0s 2019-11-25T09:39:52.929 INFO:teuthology.orchestra.run.smithi135.stderr: 61800K .......... .......... .......... .......... .......... 84% 368M 0s 2019-11-25T09:39:52.929 INFO:teuthology.orchestra.run.smithi135.stderr: 61850K .......... .......... .......... .......... .......... 84% 410M 0s 2019-11-25T09:39:52.929 INFO:teuthology.orchestra.run.smithi135.stderr: 61900K .......... .......... .......... .......... .......... 84% 390M 0s 2019-11-25T09:39:52.929 INFO:teuthology.orchestra.run.smithi135.stderr: 61950K .......... .......... .......... .......... .......... 84% 340M 0s 2019-11-25T09:39:52.929 INFO:teuthology.orchestra.run.smithi135.stderr: 62000K .......... .......... .......... .......... .......... 84% 386M 0s 2019-11-25T09:39:52.929 INFO:teuthology.orchestra.run.smithi135.stderr: 62050K .......... .......... .......... .......... .......... 84% 385M 0s 2019-11-25T09:39:52.930 INFO:teuthology.orchestra.run.smithi135.stderr: 62100K .......... .......... .......... .......... .......... 84% 365M 0s 2019-11-25T09:39:52.930 INFO:teuthology.orchestra.run.smithi135.stderr: 62150K .......... .......... .......... .......... .......... 84% 334M 0s 2019-11-25T09:39:52.930 INFO:teuthology.orchestra.run.smithi135.stderr: 62200K .......... .......... .......... .......... .......... 84% 372M 0s 2019-11-25T09:39:52.930 INFO:teuthology.orchestra.run.smithi135.stderr: 62250K .......... .......... .......... .......... .......... 84% 387M 0s 2019-11-25T09:39:52.930 INFO:teuthology.orchestra.run.smithi135.stderr: 62300K .......... .......... .......... .......... .......... 84% 410M 0s 2019-11-25T09:39:52.930 INFO:teuthology.orchestra.run.smithi135.stderr: 62350K .......... .......... .......... .......... .......... 84% 357M 0s 2019-11-25T09:39:52.930 INFO:teuthology.orchestra.run.smithi135.stderr: 62400K .......... .......... .......... .......... .......... 84% 415M 0s 2019-11-25T09:39:52.931 INFO:teuthology.orchestra.run.smithi135.stderr: 62450K .......... .......... .......... .......... .......... 84% 389M 0s 2019-11-25T09:39:52.931 INFO:teuthology.orchestra.run.smithi135.stderr: 62500K .......... .......... .......... .......... .......... 85% 423M 0s 2019-11-25T09:39:52.931 INFO:teuthology.orchestra.run.smithi135.stderr: 62550K .......... .......... .......... .......... .......... 85% 347M 0s 2019-11-25T09:39:52.931 INFO:teuthology.orchestra.run.smithi135.stderr: 62600K .......... .......... .......... .......... .......... 85% 415M 0s 2019-11-25T09:39:52.931 INFO:teuthology.orchestra.run.smithi135.stderr: 62650K .......... .......... .......... .......... .......... 85% 406M 0s 2019-11-25T09:39:52.931 INFO:teuthology.orchestra.run.smithi135.stderr: 62700K .......... .......... .......... .......... .......... 85% 391M 0s 2019-11-25T09:39:52.931 INFO:teuthology.orchestra.run.smithi135.stderr: 62750K .......... .......... .......... .......... .......... 85% 365M 0s 2019-11-25T09:39:52.932 INFO:teuthology.orchestra.run.smithi135.stderr: 62800K .......... .......... .......... .......... .......... 85% 343M 0s 2019-11-25T09:39:52.932 INFO:teuthology.orchestra.run.smithi135.stderr: 62850K .......... .......... .......... .......... .......... 85% 304M 0s 2019-11-25T09:39:52.932 INFO:teuthology.orchestra.run.smithi135.stderr: 62900K .......... .......... .......... .......... .......... 85% 193M 0s 2019-11-25T09:39:52.932 INFO:teuthology.orchestra.run.smithi135.stderr: 62950K .......... .......... .......... .......... .......... 85% 268M 0s 2019-11-25T09:39:52.932 INFO:teuthology.orchestra.run.smithi135.stderr: 63000K .......... .......... .......... .......... .......... 85% 281M 0s 2019-11-25T09:39:52.932 INFO:teuthology.orchestra.run.smithi135.stderr: 63050K .......... .......... .......... .......... .......... 85% 261M 0s 2019-11-25T09:39:52.932 INFO:teuthology.orchestra.run.smithi135.stderr: 63100K .......... .......... .......... .......... .......... 85% 262M 0s 2019-11-25T09:39:52.933 INFO:teuthology.orchestra.run.smithi135.stderr: 63150K .......... .......... .......... .......... .......... 85% 241M 0s 2019-11-25T09:39:52.933 INFO:teuthology.orchestra.run.smithi135.stderr: 63200K .......... .......... .......... .......... .......... 85% 422M 0s 2019-11-25T09:39:52.933 INFO:teuthology.orchestra.run.smithi135.stderr: 63250K .......... .......... .......... .......... .......... 86% 414M 0s 2019-11-25T09:39:52.933 INFO:teuthology.orchestra.run.smithi135.stderr: 63300K .......... .......... .......... .......... .......... 86% 409M 0s 2019-11-25T09:39:52.933 INFO:teuthology.orchestra.run.smithi135.stderr: 63350K .......... .......... .......... .......... .......... 86% 343M 0s 2019-11-25T09:39:52.933 INFO:teuthology.orchestra.run.smithi135.stderr: 63400K .......... .......... .......... .......... .......... 86% 424M 0s 2019-11-25T09:39:52.934 INFO:teuthology.orchestra.run.smithi135.stderr: 63450K .......... .......... .......... .......... .......... 86% 402M 0s 2019-11-25T09:39:52.934 INFO:teuthology.orchestra.run.smithi135.stderr: 63500K .......... .......... .......... .......... .......... 86% 420M 0s 2019-11-25T09:39:52.934 INFO:teuthology.orchestra.run.smithi135.stderr: 63550K .......... .......... .......... .......... .......... 86% 370M 0s 2019-11-25T09:39:52.934 INFO:teuthology.orchestra.run.smithi135.stderr: 63600K .......... .......... .......... .......... .......... 86% 433M 0s 2019-11-25T09:39:52.934 INFO:teuthology.orchestra.run.smithi135.stderr: 63650K .......... .......... .......... .......... .......... 86% 397M 0s 2019-11-25T09:39:52.934 INFO:teuthology.orchestra.run.smithi135.stderr: 63700K .......... .......... .......... .......... .......... 86% 423M 0s 2019-11-25T09:39:52.934 INFO:teuthology.orchestra.run.smithi135.stderr: 63750K .......... .......... .......... .......... .......... 86% 354M 0s 2019-11-25T09:39:52.935 INFO:teuthology.orchestra.run.smithi135.stderr: 63800K .......... .......... .......... .......... .......... 86% 416M 0s 2019-11-25T09:39:52.935 INFO:teuthology.orchestra.run.smithi135.stderr: 63850K .......... .......... .......... .......... .......... 86% 406M 0s 2019-11-25T09:39:52.935 INFO:teuthology.orchestra.run.smithi135.stderr: 63900K .......... .......... .......... .......... .......... 86% 400M 0s 2019-11-25T09:39:52.935 INFO:teuthology.orchestra.run.smithi135.stderr: 63950K .......... .......... .......... .......... .......... 87% 389M 0s 2019-11-25T09:39:52.935 INFO:teuthology.orchestra.run.smithi135.stderr: 64000K .......... .......... .......... .......... .......... 87% 417M 0s 2019-11-25T09:39:52.935 INFO:teuthology.orchestra.run.smithi135.stderr: 64050K .......... .......... .......... .......... .......... 87% 345M 0s 2019-11-25T09:39:52.935 INFO:teuthology.orchestra.run.smithi135.stderr: 64100K .......... .......... .......... .......... .......... 87% 410M 0s 2019-11-25T09:39:52.936 INFO:teuthology.orchestra.run.smithi135.stderr: 64150K .......... .......... .......... .......... .......... 87% 289M 0s 2019-11-25T09:39:52.936 INFO:teuthology.orchestra.run.smithi135.stderr: 64200K .......... .......... .......... .......... .......... 87% 367M 0s 2019-11-25T09:39:52.936 INFO:teuthology.orchestra.run.smithi135.stderr: 64250K .......... .......... .......... .......... .......... 87% 356M 0s 2019-11-25T09:39:52.936 INFO:teuthology.orchestra.run.smithi135.stderr: 64300K .......... .......... .......... .......... .......... 87% 313M 0s 2019-11-25T09:39:52.936 INFO:teuthology.orchestra.run.smithi135.stderr: 64350K .......... .......... .......... .......... .......... 87% 280M 0s 2019-11-25T09:39:52.936 INFO:teuthology.orchestra.run.smithi135.stderr: 64400K .......... .......... .......... .......... .......... 87% 301M 0s 2019-11-25T09:39:52.936 INFO:teuthology.orchestra.run.smithi135.stderr: 64450K .......... .......... .......... .......... .......... 87% 306M 0s 2019-11-25T09:39:52.937 INFO:teuthology.orchestra.run.smithi135.stderr: 64500K .......... .......... .......... .......... .......... 87% 307M 0s 2019-11-25T09:39:52.937 INFO:teuthology.orchestra.run.smithi135.stderr: 64550K .......... .......... .......... .......... .......... 87% 268M 0s 2019-11-25T09:39:52.937 INFO:teuthology.orchestra.run.smithi135.stderr: 64600K .......... .......... .......... .......... .......... 87% 301M 0s 2019-11-25T09:39:52.937 INFO:teuthology.orchestra.run.smithi135.stderr: 64650K .......... .......... .......... .......... .......... 87% 248M 0s 2019-11-25T09:39:52.937 INFO:teuthology.orchestra.run.smithi135.stderr: 64700K .......... .......... .......... .......... .......... 88% 294M 0s 2019-11-25T09:39:52.937 INFO:teuthology.orchestra.run.smithi135.stderr: 64750K .......... .......... .......... .......... .......... 88% 335M 0s 2019-11-25T09:39:52.937 INFO:teuthology.orchestra.run.smithi135.stderr: 64800K .......... .......... .......... .......... .......... 88% 395M 0s 2019-11-25T09:39:52.938 INFO:teuthology.orchestra.run.smithi135.stderr: 64850K .......... .......... .......... .......... .......... 88% 406M 0s 2019-11-25T09:39:52.938 INFO:teuthology.orchestra.run.smithi135.stderr: 64900K .......... .......... .......... .......... .......... 88% 384M 0s 2019-11-25T09:39:52.938 INFO:teuthology.orchestra.run.smithi135.stderr: 64950K .......... .......... .......... .......... .......... 88% 361M 0s 2019-11-25T09:39:52.938 INFO:teuthology.orchestra.run.smithi135.stderr: 65000K .......... .......... .......... .......... .......... 88% 425M 0s 2019-11-25T09:39:52.938 INFO:teuthology.orchestra.run.smithi135.stderr: 65050K .......... .......... .......... .......... .......... 88% 393M 0s 2019-11-25T09:39:52.938 INFO:teuthology.orchestra.run.smithi135.stderr: 65100K .......... .......... .......... .......... .......... 88% 418M 0s 2019-11-25T09:39:52.939 INFO:teuthology.orchestra.run.smithi135.stderr: 65150K .......... .......... .......... .......... .......... 88% 335M 0s 2019-11-25T09:39:52.939 INFO:teuthology.orchestra.run.smithi135.stderr: 65200K .......... .......... .......... .......... .......... 88% 294M 0s 2019-11-25T09:39:52.939 INFO:teuthology.orchestra.run.smithi135.stderr: 65250K .......... .......... .......... .......... .......... 88% 240M 0s 2019-11-25T09:39:52.939 INFO:teuthology.orchestra.run.smithi135.stderr: 65300K .......... .......... .......... .......... .......... 88% 251M 0s 2019-11-25T09:39:52.939 INFO:teuthology.orchestra.run.smithi135.stderr: 65350K .......... .......... .......... .......... .......... 88% 253M 0s 2019-11-25T09:39:52.939 INFO:teuthology.orchestra.run.smithi135.stderr: 65400K .......... .......... .......... .......... .......... 88% 261M 0s 2019-11-25T09:39:52.939 INFO:teuthology.orchestra.run.smithi135.stderr: 65450K .......... .......... .......... .......... .......... 89% 240M 0s 2019-11-25T09:39:52.940 INFO:teuthology.orchestra.run.smithi135.stderr: 65500K .......... .......... .......... .......... .......... 89% 233M 0s 2019-11-25T09:39:52.940 INFO:teuthology.orchestra.run.smithi135.stderr: 65550K .......... .......... .......... .......... .......... 89% 194M 0s 2019-11-25T09:39:52.940 INFO:teuthology.orchestra.run.smithi135.stderr: 65600K .......... .......... .......... .......... .......... 89% 245M 0s 2019-11-25T09:39:52.940 INFO:teuthology.orchestra.run.smithi135.stderr: 65650K .......... .......... .......... .......... .......... 89% 278M 0s 2019-11-25T09:39:52.940 INFO:teuthology.orchestra.run.smithi135.stderr: 65700K .......... .......... .......... .......... .......... 89% 371M 0s 2019-11-25T09:39:52.940 INFO:teuthology.orchestra.run.smithi135.stderr: 65750K .......... .......... .......... .......... .......... 89% 323M 0s 2019-11-25T09:39:52.940 INFO:teuthology.orchestra.run.smithi135.stderr: 65800K .......... .......... .......... .......... .......... 89% 382M 0s 2019-11-25T09:39:52.941 INFO:teuthology.orchestra.run.smithi135.stderr: 65850K .......... .......... .......... .......... .......... 89% 326M 0s 2019-11-25T09:39:52.941 INFO:teuthology.orchestra.run.smithi135.stderr: 65900K .......... .......... .......... .......... .......... 89% 406M 0s 2019-11-25T09:39:52.941 INFO:teuthology.orchestra.run.smithi135.stderr: 65950K .......... .......... .......... .......... .......... 89% 359M 0s 2019-11-25T09:39:52.941 INFO:teuthology.orchestra.run.smithi135.stderr: 66000K .......... .......... .......... .......... .......... 89% 410M 0s 2019-11-25T09:39:52.941 INFO:teuthology.orchestra.run.smithi135.stderr: 66050K .......... .......... .......... .......... .......... 89% 397M 0s 2019-11-25T09:39:52.941 INFO:teuthology.orchestra.run.smithi135.stderr: 66100K .......... .......... .......... .......... .......... 89% 413M 0s 2019-11-25T09:39:52.941 INFO:teuthology.orchestra.run.smithi135.stderr: 66150K .......... .......... .......... .......... .......... 89% 328M 0s 2019-11-25T09:39:52.942 INFO:teuthology.orchestra.run.smithi135.stderr: 66200K .......... .......... .......... .......... .......... 90% 403M 0s 2019-11-25T09:39:52.942 INFO:teuthology.orchestra.run.smithi135.stderr: 66250K .......... .......... .......... .......... .......... 90% 309M 0s 2019-11-25T09:39:52.942 INFO:teuthology.orchestra.run.smithi135.stderr: 66300K .......... .......... .......... .......... .......... 90% 238M 0s 2019-11-25T09:39:52.942 INFO:teuthology.orchestra.run.smithi135.stderr: 66350K .......... .......... .......... .......... .......... 90% 210M 0s 2019-11-25T09:39:52.942 INFO:teuthology.orchestra.run.smithi135.stderr: 66400K .......... .......... .......... .......... .......... 90% 238M 0s 2019-11-25T09:39:52.942 INFO:teuthology.orchestra.run.smithi135.stderr: 66450K .......... .......... .......... .......... .......... 90% 255M 0s 2019-11-25T09:39:52.943 INFO:teuthology.orchestra.run.smithi135.stderr: 66500K .......... .......... .......... .......... .......... 90% 376M 0s 2019-11-25T09:39:52.943 INFO:teuthology.orchestra.run.smithi135.stderr: 66550K .......... .......... .......... .......... .......... 90% 345M 0s 2019-11-25T09:39:52.943 INFO:teuthology.orchestra.run.smithi135.stderr: 66600K .......... .......... .......... .......... .......... 90% 415M 0s 2019-11-25T09:39:52.943 INFO:teuthology.orchestra.run.smithi135.stderr: 66650K .......... .......... .......... .......... .......... 90% 414M 0s 2019-11-25T09:39:52.943 INFO:teuthology.orchestra.run.smithi135.stderr: 66700K .......... .......... .......... .......... .......... 90% 361M 0s 2019-11-25T09:39:52.943 INFO:teuthology.orchestra.run.smithi135.stderr: 66750K .......... .......... .......... .......... .......... 90% 358M 0s 2019-11-25T09:39:52.943 INFO:teuthology.orchestra.run.smithi135.stderr: 66800K .......... .......... .......... .......... .......... 90% 380M 0s 2019-11-25T09:39:52.944 INFO:teuthology.orchestra.run.smithi135.stderr: 66850K .......... .......... .......... .......... .......... 90% 395M 0s 2019-11-25T09:39:52.944 INFO:teuthology.orchestra.run.smithi135.stderr: 66900K .......... .......... .......... .......... .......... 91% 387M 0s 2019-11-25T09:39:52.944 INFO:teuthology.orchestra.run.smithi135.stderr: 66950K .......... .......... .......... .......... .......... 91% 335M 0s 2019-11-25T09:39:52.944 INFO:teuthology.orchestra.run.smithi135.stderr: 67000K .......... .......... .......... .......... .......... 91% 394M 0s 2019-11-25T09:39:52.944 INFO:teuthology.orchestra.run.smithi135.stderr: 67050K .......... .......... .......... .......... .......... 91% 401M 0s 2019-11-25T09:39:52.944 INFO:teuthology.orchestra.run.smithi135.stderr: 67100K .......... .......... .......... .......... .......... 91% 360M 0s 2019-11-25T09:39:52.944 INFO:teuthology.orchestra.run.smithi135.stderr: 67150K .......... .......... .......... .......... .......... 91% 337M 0s 2019-11-25T09:39:52.945 INFO:teuthology.orchestra.run.smithi135.stderr: 67200K .......... .......... .......... .......... .......... 91% 389M 0s 2019-11-25T09:39:52.945 INFO:teuthology.orchestra.run.smithi135.stderr: 67250K .......... .......... .......... .......... .......... 91% 398M 0s 2019-11-25T09:39:52.945 INFO:teuthology.orchestra.run.smithi135.stderr: 67300K .......... .......... .......... .......... .......... 91% 412M 0s 2019-11-25T09:39:52.945 INFO:teuthology.orchestra.run.smithi135.stderr: 67350K .......... .......... .......... .......... .......... 91% 343M 0s 2019-11-25T09:39:52.945 INFO:teuthology.orchestra.run.smithi135.stderr: 67400K .......... .......... .......... .......... .......... 91% 395M 0s 2019-11-25T09:39:52.945 INFO:teuthology.orchestra.run.smithi135.stderr: 67450K .......... .......... .......... .......... .......... 91% 405M 0s 2019-11-25T09:39:52.945 INFO:teuthology.orchestra.run.smithi135.stderr: 67500K .......... .......... .......... .......... .......... 91% 388M 0s 2019-11-25T09:39:52.946 INFO:teuthology.orchestra.run.smithi135.stderr: 67550K .......... .......... .......... .......... .......... 91% 348M 0s 2019-11-25T09:39:52.946 INFO:teuthology.orchestra.run.smithi135.stderr: 67600K .......... .......... .......... .......... .......... 91% 407M 0s 2019-11-25T09:39:52.946 INFO:teuthology.orchestra.run.smithi135.stderr: 67650K .......... .......... .......... .......... .......... 92% 399M 0s 2019-11-25T09:39:52.946 INFO:teuthology.orchestra.run.smithi135.stderr: 67700K .......... .......... .......... .......... .......... 92% 368M 0s 2019-11-25T09:39:52.946 INFO:teuthology.orchestra.run.smithi135.stderr: 67750K .......... .......... .......... .......... .......... 92% 311M 0s 2019-11-25T09:39:52.946 INFO:teuthology.orchestra.run.smithi135.stderr: 67800K .......... .......... .......... .......... .......... 92% 407M 0s 2019-11-25T09:39:52.947 INFO:teuthology.orchestra.run.smithi135.stderr: 67850K .......... .......... .......... .......... .......... 92% 420M 0s 2019-11-25T09:39:52.947 INFO:teuthology.orchestra.run.smithi135.stderr: 67900K .......... .......... .......... .......... .......... 92% 414M 0s 2019-11-25T09:39:52.947 INFO:teuthology.orchestra.run.smithi135.stderr: 67950K .......... .......... .......... .......... .......... 92% 352M 0s 2019-11-25T09:39:52.947 INFO:teuthology.orchestra.run.smithi135.stderr: 68000K .......... .......... .......... .......... .......... 92% 420M 0s 2019-11-25T09:39:52.947 INFO:teuthology.orchestra.run.smithi135.stderr: 68050K .......... .......... .......... .......... .......... 92% 415M 0s 2019-11-25T09:39:52.947 INFO:teuthology.orchestra.run.smithi135.stderr: 68100K .......... .......... .......... .......... .......... 92% 419M 0s 2019-11-25T09:39:52.947 INFO:teuthology.orchestra.run.smithi135.stderr: 68150K .......... .......... .......... .......... .......... 92% 335M 0s 2019-11-25T09:39:52.948 INFO:teuthology.orchestra.run.smithi135.stderr: 68200K .......... .......... .......... .......... .......... 92% 419M 0s 2019-11-25T09:39:52.948 INFO:teuthology.orchestra.run.smithi135.stderr: 68250K .......... .......... .......... .......... .......... 92% 412M 0s 2019-11-25T09:39:52.948 INFO:teuthology.orchestra.run.smithi135.stderr: 68300K .......... .......... .......... .......... .......... 92% 411M 0s 2019-11-25T09:39:52.948 INFO:teuthology.orchestra.run.smithi135.stderr: 68350K .......... .......... .......... .......... .......... 92% 358M 0s 2019-11-25T09:39:52.948 INFO:teuthology.orchestra.run.smithi135.stderr: 68400K .......... .......... .......... .......... .......... 93% 410M 0s 2019-11-25T09:39:52.948 INFO:teuthology.orchestra.run.smithi135.stderr: 68450K .......... .......... .......... .......... .......... 93% 424M 0s 2019-11-25T09:39:52.948 INFO:teuthology.orchestra.run.smithi135.stderr: 68500K .......... .......... .......... .......... .......... 93% 416M 0s 2019-11-25T09:39:52.949 INFO:teuthology.orchestra.run.smithi135.stderr: 68550K .......... .......... .......... .......... .......... 93% 324M 0s 2019-11-25T09:39:52.949 INFO:teuthology.orchestra.run.smithi135.stderr: 68600K .......... .......... .......... .......... .......... 93% 405M 0s 2019-11-25T09:39:52.949 INFO:teuthology.orchestra.run.smithi135.stderr: 68650K .......... .......... .......... .......... .......... 93% 382M 0s 2019-11-25T09:39:52.949 INFO:teuthology.orchestra.run.smithi135.stderr: 68700K .......... .......... .......... .......... .......... 93% 377M 0s 2019-11-25T09:39:52.949 INFO:teuthology.orchestra.run.smithi135.stderr: 68750K .......... .......... .......... .......... .......... 93% 342M 0s 2019-11-25T09:39:52.949 INFO:teuthology.orchestra.run.smithi135.stderr: 68800K .......... .......... .......... .......... .......... 93% 371M 0s 2019-11-25T09:39:52.949 INFO:teuthology.orchestra.run.smithi135.stderr: 68850K .......... .......... .......... .......... .......... 93% 420M 0s 2019-11-25T09:39:52.950 INFO:teuthology.orchestra.run.smithi135.stderr: 68900K .......... .......... .......... .......... .......... 93% 386M 0s 2019-11-25T09:39:52.950 INFO:teuthology.orchestra.run.smithi135.stderr: 68950K .......... .......... .......... .......... .......... 93% 343M 0s 2019-11-25T09:39:52.950 INFO:teuthology.orchestra.run.smithi135.stderr: 69000K .......... .......... .......... .......... .......... 93% 385M 0s 2019-11-25T09:39:52.950 INFO:teuthology.orchestra.run.smithi135.stderr: 69050K .......... .......... .......... .......... .......... 93% 424M 0s 2019-11-25T09:39:52.950 INFO:teuthology.orchestra.run.smithi135.stderr: 69100K .......... .......... .......... .......... .......... 94% 399M 0s 2019-11-25T09:39:52.950 INFO:teuthology.orchestra.run.smithi135.stderr: 69150K .......... .......... .......... .......... .......... 94% 342M 0s 2019-11-25T09:39:52.950 INFO:teuthology.orchestra.run.smithi135.stderr: 69200K .......... .......... .......... .......... .......... 94% 405M 0s 2019-11-25T09:39:52.951 INFO:teuthology.orchestra.run.smithi135.stderr: 69250K .......... .......... .......... .......... .......... 94% 423M 0s 2019-11-25T09:39:52.951 INFO:teuthology.orchestra.run.smithi135.stderr: 69300K .......... .......... .......... .......... .......... 94% 397M 0s 2019-11-25T09:39:52.951 INFO:teuthology.orchestra.run.smithi135.stderr: 69350K .......... .......... .......... .......... .......... 94% 338M 0s 2019-11-25T09:39:52.951 INFO:teuthology.orchestra.run.smithi135.stderr: 69400K .......... .......... .......... .......... .......... 94% 380M 0s 2019-11-25T09:39:52.951 INFO:teuthology.orchestra.run.smithi135.stderr: 69450K .......... .......... .......... .......... .......... 94% 418M 0s 2019-11-25T09:39:52.951 INFO:teuthology.orchestra.run.smithi135.stderr: 69500K .......... .......... .......... .......... .......... 94% 394M 0s 2019-11-25T09:39:52.952 INFO:teuthology.orchestra.run.smithi135.stderr: 69550K .......... .......... .......... .......... .......... 94% 301M 0s 2019-11-25T09:39:52.952 INFO:teuthology.orchestra.run.smithi135.stderr: 69600K .......... .......... .......... .......... .......... 94% 411M 0s 2019-11-25T09:39:52.952 INFO:teuthology.orchestra.run.smithi135.stderr: 69650K .......... .......... .......... .......... .......... 94% 393M 0s 2019-11-25T09:39:52.952 INFO:teuthology.orchestra.run.smithi135.stderr: 69700K .......... .......... .......... .......... .......... 94% 344M 0s 2019-11-25T09:39:52.952 INFO:teuthology.orchestra.run.smithi135.stderr: 69750K .......... .......... .......... .......... .......... 94% 318M 0s 2019-11-25T09:39:52.952 INFO:teuthology.orchestra.run.smithi135.stderr: 69800K .......... .......... .......... .......... .......... 94% 369M 0s 2019-11-25T09:39:52.952 INFO:teuthology.orchestra.run.smithi135.stderr: 69850K .......... .......... .......... .......... .......... 95% 339M 0s 2019-11-25T09:39:52.953 INFO:teuthology.orchestra.run.smithi135.stderr: 69900K .......... .......... .......... .......... .......... 95% 330M 0s 2019-11-25T09:39:52.953 INFO:teuthology.orchestra.run.smithi135.stderr: 69950K .......... .......... .......... .......... .......... 95% 315M 0s 2019-11-25T09:39:52.953 INFO:teuthology.orchestra.run.smithi135.stderr: 70000K .......... .......... .......... .......... .......... 95% 354M 0s 2019-11-25T09:39:52.953 INFO:teuthology.orchestra.run.smithi135.stderr: 70050K .......... .......... .......... .......... .......... 95% 363M 0s 2019-11-25T09:39:52.953 INFO:teuthology.orchestra.run.smithi135.stderr: 70100K .......... .......... .......... .......... .......... 95% 404M 0s 2019-11-25T09:39:52.953 INFO:teuthology.orchestra.run.smithi135.stderr: 70150K .......... .......... .......... .......... .......... 95% 346M 0s 2019-11-25T09:39:52.953 INFO:teuthology.orchestra.run.smithi135.stderr: 70200K .......... .......... .......... .......... .......... 95% 416M 0s 2019-11-25T09:39:52.954 INFO:teuthology.orchestra.run.smithi135.stderr: 70250K .......... .......... .......... .......... .......... 95% 409M 0s 2019-11-25T09:39:52.954 INFO:teuthology.orchestra.run.smithi135.stderr: 70300K .......... .......... .......... .......... .......... 95% 416M 0s 2019-11-25T09:39:52.954 INFO:teuthology.orchestra.run.smithi135.stderr: 70350K .......... .......... .......... .......... .......... 95% 346M 0s 2019-11-25T09:39:52.954 INFO:teuthology.orchestra.run.smithi135.stderr: 70400K .......... .......... .......... .......... .......... 95% 397M 0s 2019-11-25T09:39:52.954 INFO:teuthology.orchestra.run.smithi135.stderr: 70450K .......... .......... .......... .......... .......... 95% 398M 0s 2019-11-25T09:39:52.954 INFO:teuthology.orchestra.run.smithi135.stderr: 70500K .......... .......... .......... .......... .......... 95% 409M 0s 2019-11-25T09:39:52.954 INFO:teuthology.orchestra.run.smithi135.stderr: 70550K .......... .......... .......... .......... .......... 95% 354M 0s 2019-11-25T09:39:52.955 INFO:teuthology.orchestra.run.smithi135.stderr: 70600K .......... .......... .......... .......... .......... 96% 411M 0s 2019-11-25T09:39:52.955 INFO:teuthology.orchestra.run.smithi135.stderr: 70650K .......... .......... .......... .......... .......... 96% 415M 0s 2019-11-25T09:39:52.955 INFO:teuthology.orchestra.run.smithi135.stderr: 70700K .......... .......... .......... .......... .......... 96% 77.4M 0s 2019-11-25T09:39:52.955 INFO:teuthology.orchestra.run.smithi135.stderr: 70750K .......... .......... .......... .......... .......... 96% 107M 0s 2019-11-25T09:39:52.955 INFO:teuthology.orchestra.run.smithi135.stderr: 70800K .......... .......... .......... .......... .......... 96% 223M 0s 2019-11-25T09:39:52.955 INFO:teuthology.orchestra.run.smithi135.stderr: 70850K .......... .......... .......... .......... .......... 96% 425M 0s 2019-11-25T09:39:52.956 INFO:teuthology.orchestra.run.smithi135.stderr: 70900K .......... .......... .......... .......... .......... 96% 136M 0s 2019-11-25T09:39:52.956 INFO:teuthology.orchestra.run.smithi135.stderr: 70950K .......... .......... .......... .......... .......... 96% 290M 0s 2019-11-25T09:39:52.956 INFO:teuthology.orchestra.run.smithi135.stderr: 71000K .......... .......... .......... .......... .......... 96% 417M 0s 2019-11-25T09:39:52.956 INFO:teuthology.orchestra.run.smithi135.stderr: 71050K .......... .......... .......... .......... .......... 96% 72.7M 0s 2019-11-25T09:39:52.956 INFO:teuthology.orchestra.run.smithi135.stderr: 71100K .......... .......... .......... .......... .......... 96% 274M 0s 2019-11-25T09:39:52.956 INFO:teuthology.orchestra.run.smithi135.stderr: 71150K .......... .......... .......... .......... .......... 96% 329M 0s 2019-11-25T09:39:52.956 INFO:teuthology.orchestra.run.smithi135.stderr: 71200K .......... .......... .......... .......... .......... 96% 393M 0s 2019-11-25T09:39:52.956 INFO:teuthology.orchestra.run.smithi135.stderr: 71250K .......... .......... .......... .......... .......... 96% 413M 0s 2019-11-25T09:39:52.957 INFO:teuthology.orchestra.run.smithi135.stderr: 71300K .......... .......... .......... .......... .......... 96% 410M 0s 2019-11-25T09:39:52.957 INFO:teuthology.orchestra.run.smithi135.stderr: 71350K .......... .......... .......... .......... .......... 97% 367M 0s 2019-11-25T09:39:52.957 INFO:teuthology.orchestra.run.smithi135.stderr: 71400K .......... .......... .......... .......... .......... 97% 389M 0s 2019-11-25T09:39:52.957 INFO:teuthology.orchestra.run.smithi135.stderr: 71450K .......... .......... .......... .......... .......... 97% 407M 0s 2019-11-25T09:39:52.957 INFO:teuthology.orchestra.run.smithi135.stderr: 71500K .......... .......... .......... .......... .......... 97% 74.5M 0s 2019-11-25T09:39:52.957 INFO:teuthology.orchestra.run.smithi135.stderr: 71550K .......... .......... .......... .......... .......... 97% 321M 0s 2019-11-25T09:39:52.957 INFO:teuthology.orchestra.run.smithi135.stderr: 71600K .......... .......... .......... .......... .......... 97% 423M 0s 2019-11-25T09:39:52.958 INFO:teuthology.orchestra.run.smithi135.stderr: 71650K .......... .......... .......... .......... .......... 97% 127M 0s 2019-11-25T09:39:52.958 INFO:teuthology.orchestra.run.smithi135.stderr: 71700K .......... .......... .......... .......... .......... 97% 359M 0s 2019-11-25T09:39:52.958 INFO:teuthology.orchestra.run.smithi135.stderr: 71750K .......... .......... .......... .......... .......... 97% 386M 0s 2019-11-25T09:39:52.958 INFO:teuthology.orchestra.run.smithi135.stderr: 71800K .......... .......... .......... .......... .......... 97% 179M 0s 2019-11-25T09:39:52.958 INFO:teuthology.orchestra.run.smithi135.stderr: 71850K .......... .......... .......... .......... .......... 97% 221M 0s 2019-11-25T09:39:52.958 INFO:teuthology.orchestra.run.smithi135.stderr: 71900K .......... .......... .......... .......... .......... 97% 319M 0s 2019-11-25T09:39:52.958 INFO:teuthology.orchestra.run.smithi135.stderr: 71950K .......... .......... .......... .......... .......... 97% 359M 0s 2019-11-25T09:39:52.959 INFO:teuthology.orchestra.run.smithi135.stderr: 72000K .......... .......... .......... .......... .......... 97% 41.8M 0s 2019-11-25T09:39:52.959 INFO:teuthology.orchestra.run.smithi135.stderr: 72050K .......... .......... .......... .......... .......... 98% 385M 0s 2019-11-25T09:39:52.959 INFO:teuthology.orchestra.run.smithi135.stderr: 72100K .......... .......... .......... .......... .......... 98% 376M 0s 2019-11-25T09:39:52.959 INFO:teuthology.orchestra.run.smithi135.stderr: 72150K .......... .......... .......... .......... .......... 98% 384M 0s 2019-11-25T09:39:52.959 INFO:teuthology.orchestra.run.smithi135.stderr: 72200K .......... .......... .......... .......... .......... 98% 49.0M 0s 2019-11-25T09:39:52.959 INFO:teuthology.orchestra.run.smithi135.stderr: 72250K .......... .......... .......... .......... .......... 98% 345M 0s 2019-11-25T09:39:52.959 INFO:teuthology.orchestra.run.smithi135.stderr: 72300K .......... .......... .......... .......... .......... 98% 386M 0s 2019-11-25T09:39:52.960 INFO:teuthology.orchestra.run.smithi135.stderr: 72350K .......... .......... .......... .......... .......... 98% 300M 0s 2019-11-25T09:39:52.960 INFO:teuthology.orchestra.run.smithi135.stderr: 72400K .......... .......... .......... .......... .......... 98% 414M 0s 2019-11-25T09:39:52.960 INFO:teuthology.orchestra.run.smithi135.stderr: 72450K .......... .......... .......... .......... .......... 98% 398M 0s 2019-11-25T09:39:52.960 INFO:teuthology.orchestra.run.smithi135.stderr: 72500K .......... .......... .......... .......... .......... 98% 337M 0s 2019-11-25T09:39:52.960 INFO:teuthology.orchestra.run.smithi135.stderr: 72550K .......... .......... .......... .......... .......... 98% 306M 0s 2019-11-25T09:39:52.960 INFO:teuthology.orchestra.run.smithi135.stderr: 72600K .......... .......... .......... .......... .......... 98% 401M 0s 2019-11-25T09:39:52.960 INFO:teuthology.orchestra.run.smithi135.stderr: 72650K .......... .......... .......... .......... .......... 98% 361M 0s 2019-11-25T09:39:52.961 INFO:teuthology.orchestra.run.smithi135.stderr: 72700K .......... .......... .......... .......... .......... 98% 334M 0s 2019-11-25T09:39:52.961 INFO:teuthology.orchestra.run.smithi135.stderr: 72750K .......... .......... .......... .......... .......... 98% 300M 0s 2019-11-25T09:39:52.961 INFO:teuthology.orchestra.run.smithi135.stderr: 72800K .......... .......... .......... .......... .......... 99% 402M 0s 2019-11-25T09:39:52.961 INFO:teuthology.orchestra.run.smithi135.stderr: 72850K .......... .......... .......... .......... .......... 99% 394M 0s 2019-11-25T09:39:52.961 INFO:teuthology.orchestra.run.smithi135.stderr: 72900K .......... .......... .......... .......... .......... 99% 338M 0s 2019-11-25T09:39:52.961 INFO:teuthology.orchestra.run.smithi135.stderr: 72950K .......... .......... .......... .......... .......... 99% 318M 0s 2019-11-25T09:39:52.961 INFO:teuthology.orchestra.run.smithi135.stderr: 73000K .......... .......... .......... .......... .......... 99% 414M 0s 2019-11-25T09:39:52.961 INFO:teuthology.orchestra.run.smithi135.stderr: 73050K .......... .......... .......... .......... .......... 99% 420M 0s 2019-11-25T09:39:52.962 INFO:teuthology.orchestra.run.smithi135.stderr: 73100K .......... .......... .......... .......... .......... 99% 20.0M 0s 2019-11-25T09:39:52.962 INFO:teuthology.orchestra.run.smithi135.stderr: 73150K .......... .......... .......... .......... .......... 99% 246M 0s 2019-11-25T09:39:52.962 INFO:teuthology.orchestra.run.smithi135.stderr: 73200K .......... .......... .......... .......... .......... 99% 417M 0s 2019-11-25T09:39:52.962 INFO:teuthology.orchestra.run.smithi135.stderr: 73250K .......... .......... .......... .......... .......... 99% 382M 0s 2019-11-25T09:39:52.962 INFO:teuthology.orchestra.run.smithi135.stderr: 73300K .......... .......... .......... .......... .......... 99% 389M 0s 2019-11-25T09:39:52.962 INFO:teuthology.orchestra.run.smithi135.stderr: 73350K .......... .......... .......... .......... .......... 99% 348M 0s 2019-11-25T09:39:52.962 INFO:teuthology.orchestra.run.smithi135.stderr: 73400K .......... .......... .......... .......... .......... 99% 424M 0s 2019-11-25T09:39:52.963 INFO:teuthology.orchestra.run.smithi135.stderr: 73450K .......... .......... .......... .......... .......... 99% 416M 0s 2019-11-25T09:39:52.963 INFO:teuthology.orchestra.run.smithi135.stderr: 73500K .......... .......... .......... .......... .......... 99% 425M 0s 2019-11-25T09:39:52.963 INFO:teuthology.orchestra.run.smithi135.stderr: 73550K ........ 100% 382M=0.3s 2019-11-25T09:39:52.963 INFO:teuthology.orchestra.run.smithi135.stderr: 2019-11-25T09:39:52.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25 09:39:51 (212 MB/s) - ‘gradle-4.7-bin.zip’ saved [75323957/75323957] 2019-11-25T09:39:52.963 INFO:teuthology.orchestra.run.smithi135.stderr: 2019-11-25T09:39:52.963 INFO:teuthology.orchestra.run.smithi135.stdout:Archive: gradle-4.7-bin.zip 2019-11-25T09:39:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: creating: /opt/gradle/gradle-4.7/ 2019-11-25T09:39:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/getting-started.html 2019-11-25T09:39:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/LICENSE 2019-11-25T09:39:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: creating: /opt/gradle/gradle-4.7/media/ 2019-11-25T09:39:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-64x64.png 2019-11-25T09:39:52.964 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-48x48.png 2019-11-25T09:39:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle.icns 2019-11-25T09:39:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-24x24.png 2019-11-25T09:39:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-256x256.png 2019-11-25T09:39:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-512x512.png 2019-11-25T09:39:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-16x16.png 2019-11-25T09:39:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-32x32.png 2019-11-25T09:39:52.965 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-128x128.png 2019-11-25T09:39:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: creating: /opt/gradle/gradle-4.7/init.d/ 2019-11-25T09:39:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/init.d/readme.txt 2019-11-25T09:39:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/NOTICE 2019-11-25T09:39:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: creating: /opt/gradle/gradle-4.7/bin/ 2019-11-25T09:39:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle.bat 2019-11-25T09:39:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle 2019-11-25T09:39:52.966 INFO:teuthology.orchestra.run.smithi135.stdout: creating: /opt/gradle/gradle-4.7/lib/ 2019-11-25T09:39:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/annotations-13.0.jar 2019-11-25T09:39:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-0.16.3.jar 2019-11-25T09:39:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-builders-0.16.3.jar 2019-11-25T09:39:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-models-0.16.3.jar 2019-11-25T09:39:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-compiler-embeddable-1.2.31.jar 2019-11-25T09:39:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-reflect-1.2.31.jar 2019-11-25T09:39:52.967 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-sam-with-receiver-compiler-plugin-1.2.31.jar 2019-11-25T09:39:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-script-runtime-1.2.31.jar 2019-11-25T09:39:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-1.2.31.jar 2019-11-25T09:39:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk7-1.2.31.jar 2019-11-25T09:39:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk8-1.2.31.jar 2019-11-25T09:39:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-launcher-4.7.jar 2019-11-25T09:39:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-runtime-api-info-4.7.jar 2019-11-25T09:39:52.968 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-tooling-api-4.7.jar 2019-11-25T09:39:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-wrapper-4.7.jar 2019-11-25T09:39:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-installation-beacon-4.7.jar 2019-11-25T09:39:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-4.7.jar 2019-11-25T09:39:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-jvm-services-4.7.jar 2019-11-25T09:39:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-api-4.7.jar 2019-11-25T09:39:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-cache-4.7.jar 2019-11-25T09:39:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-logging-4.7.jar 2019-11-25T09:39:52.969 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-process-services-4.7.jar 2019-11-25T09:39:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-resources-4.7.jar 2019-11-25T09:39:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-persistent-cache-4.7.jar 2019-11-25T09:39:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-native-4.7.jar 2019-11-25T09:39:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-groovy-4.7.jar 2019-11-25T09:39:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-core-4.7.jar 2019-11-25T09:39:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-groovy-4.7.jar 2019-11-25T09:39:52.970 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-messaging-4.7.jar 2019-11-25T09:39:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-4.7.jar 2019-11-25T09:39:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-option-4.7.jar 2019-11-25T09:39:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-cli-4.7.jar 2019-11-25T09:39:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-docs-4.7.jar 2019-11-25T09:39:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-commons-6.1.1.jar 2019-11-25T09:39:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-analysis-6.1.1.jar 2019-11-25T09:39:52.971 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-tree-6.1.1.jar 2019-11-25T09:39:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/kryo-2.20.jar 2019-11-25T09:39:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/reflectasm-1.07-shaded.jar 2019-11-25T09:39:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-6.1.1.jar 2019-11-25T09:39:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-io-2.4.jar 2019-11-25T09:39:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcl-over-slf4j-1.7.16.jar 2019-11-25T09:39:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/jul-to-slf4j-1.7.16.jar 2019-11-25T09:39:52.972 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/log4j-over-slf4j-1.7.16.jar 2019-11-25T09:39:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/slf4j-api-1.7.16.jar 2019-11-25T09:39:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/guava-jdk5-17.0.jar 2019-11-25T09:39:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/jsr305-2.0.1.jar 2019-11-25T09:39:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/fastutil-7.2.1-min.jar 2019-11-25T09:39:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-lang-2.6.jar 2019-11-25T09:39:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcip-annotations-1.0.jar 2019-11-25T09:39:52.973 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/groovy-all-2.4.12.jar 2019-11-25T09:39:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-1.9.9.jar 2019-11-25T09:39:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/javax.inject-1.jar 2019-11-25T09:39:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-collections-3.2.2.jar 2019-11-25T09:39:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-0.14.jar 2019-11-25T09:39:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-compress-1.14.jar 2019-11-25T09:39:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/xml-apis-1.4.01.jar 2019-11-25T09:39:52.974 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/jansi-1.14.jar 2019-11-25T09:39:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-launcher-1.9.9.jar 2019-11-25T09:39:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libcpp-0.14.jar 2019-11-25T09:39:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libstdcpp-0.14.jar 2019-11-25T09:39:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libcpp-0.14.jar 2019-11-25T09:39:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libstdcpp-0.14.jar 2019-11-25T09:39:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-0.14.jar 2019-11-25T09:39:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-0.14.jar 2019-11-25T09:39:52.975 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-amd64-0.14.jar 2019-11-25T09:39:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-i386-0.14.jar 2019-11-25T09:39:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-amd64-0.14.jar 2019-11-25T09:39:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-i386-0.14.jar 2019-11-25T09:39:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses5-0.14.jar 2019-11-25T09:39:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses6-0.14.jar 2019-11-25T09:39:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses5-0.14.jar 2019-11-25T09:39:52.976 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses6-0.14.jar 2019-11-25T09:39:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/minlog-1.2.jar 2019-11-25T09:39:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/objenesis-1.2.jar 2019-11-25T09:39:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: creating: /opt/gradle/gradle-4.7/lib/plugins/ 2019-11-25T09:39:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-announce-4.7.jar 2019-11-25T09:39:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-antlr-4.7.jar 2019-11-25T09:39:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-code-quality-4.7.jar 2019-11-25T09:39:52.977 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-osgi-4.7.jar 2019-11-25T09:39:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-signing-4.7.jar 2019-11-25T09:39:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-native-4.7.jar 2019-11-25T09:39:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-native-4.7.jar 2019-11-25T09:39:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-native-4.7.jar 2019-11-25T09:39:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-development-4.7.jar 2019-11-25T09:39:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-maven-4.7.jar 2019-11-25T09:39:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-play-4.7.jar 2019-11-25T09:39:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-4.7.jar 2019-11-25T09:39:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-scala-4.7.jar 2019-11-25T09:39:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-comparison-4.7.jar 2019-11-25T09:39:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ear-4.7.jar 2019-11-25T09:39:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-play-4.7.jar 2019-11-25T09:39:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-javascript-4.7.jar 2019-11-25T09:39:52.979 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ivy-4.7.jar 2019-11-25T09:39:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-jacoco-4.7.jar 2019-11-25T09:39:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-init-4.7.jar 2019-11-25T09:39:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugins-4.7.jar 2019-11-25T09:39:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-tooling-api-builders-4.7.jar 2019-11-25T09:39:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-test-kit-4.7.jar 2019-11-25T09:39:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-composite-builds-4.7.jar 2019-11-25T09:39:52.980 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-groovy-4.7.jar 2019-11-25T09:39:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-scala-4.7.jar 2019-11-25T09:39:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-junit-platform-4.7.jar 2019-11-25T09:39:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-jvm-4.7.jar 2019-11-25T09:39:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-java-4.7.jar 2019-11-25T09:39:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-jvm-4.7.jar 2019-11-25T09:39:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-jvm-4.7.jar 2019-11-25T09:39:52.981 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-native-4.7.jar 2019-11-25T09:39:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-diagnostics-4.7.jar 2019-11-25T09:39:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-base-4.7.jar 2019-11-25T09:39:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-reporting-4.7.jar 2019-11-25T09:39:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-publish-4.7.jar 2019-11-25T09:39:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-base-4.7.jar 2019-11-25T09:39:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-use-4.7.jar 2019-11-25T09:39:52.982 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-s3-4.7.jar 2019-11-25T09:39:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-gcs-4.7.jar 2019-11-25T09:39:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-cache-http-4.7.jar 2019-11-25T09:39:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-dependency-management-4.7.jar 2019-11-25T09:39:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-http-4.7.jar 2019-11-25T09:39:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-sftp-4.7.jar 2019-11-25T09:39:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-workers-4.7.jar 2019-11-25T09:39:52.983 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-version-control-4.7.jar 2019-11-25T09:39:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-s3-1.11.267.jar 2019-11-25T09:39:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-kms-1.11.267.jar 2019-11-25T09:39:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-core-1.11.267.jar 2019-11-25T09:39:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/org.eclipse.jgit-4.5.3.201708160445-r.jar 2019-11-25T09:39:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-2.4.jar 2019-11-25T09:39:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-shared4-2.4.jar 2019-11-25T09:39:52.984 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-services-storage-v1-rev116-1.23.0.jar 2019-11-25T09:39:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-client-1.23.0.jar 2019-11-25T09:39:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-oauth-client-1.23.0.jar 2019-11-25T09:39:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-jackson2-1.23.0.jar 2019-11-25T09:39:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-1.23.0.jar 2019-11-25T09:39:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpclient-4.5.5.jar 2019-11-25T09:39:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-codec-1.10.jar 2019-11-25T09:39:52.985 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-container-default-1.5.5.jar 2019-11-25T09:39:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xbean-reflect-3.4.jar 2019-11-25T09:39:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/asm-util-6.1.1.jar 2019-11-25T09:39:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jatl-0.2.2.jar 2019-11-25T09:39:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-cli-1.2.jar 2019-11-25T09:39:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/biz.aQute.bndlib-3.4.0.jar 2019-11-25T09:39:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ivy-2.2.0.jar 2019-11-25T09:39:52.986 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-compat-3.0.4.jar 2019-11-25T09:39:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-core-3.0.4.jar 2019-11-25T09:39:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-common-0.8-20100325.jar 2019-11-25T09:39:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-groovy-0.8-20100325.jar 2019-11-25T09:39:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-file-2.4.jar 2019-11-25T09:39:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-connector-wagon-1.13.1.jar 2019-11-25T09:39:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcpg-jdk15on-1.58.jar 2019-11-25T09:39:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/rhino-1.7R3.jar 2019-11-25T09:39:52.987 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gson-2.7.jar 2019-11-25T09:39:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/simple-4.1.21.jar 2019-11-25T09:39:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-plugin-api-3.0.4.jar 2019-11-25T09:39:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/testng-6.3.1.jar 2019-11-25T09:39:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/snakeyaml-1.6.jar 2019-11-25T09:39:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/dd-plist-1.20.jar 2019-11-25T09:39:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-4.12.jar 2019-11-25T09:39:52.988 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bsh-2.0b6.jar 2019-11-25T09:39:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-launcher-1.0.3.jar 2019-11-25T09:39:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcifs-1.3.17.jar 2019-11-25T09:39:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/nekohtml-1.9.20.jar 2019-11-25T09:39:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xercesImpl-2.11.0.jar 2019-11-25T09:39:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jsch-0.1.54.jar 2019-11-25T09:39:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jmespath-java-1.11.267.jar 2019-11-25T09:39:52.989 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-databind-2.8.11.jar 2019-11-25T09:39:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-core-2.8.11.jar 2019-11-25T09:39:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-annotations-2.8.11.jar 2019-11-25T09:39:52.990 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/joda-time-2.8.2.jar 2019-11-25T09:39:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcprov-jdk15on-1.58.jar 2019-11-25T09:39:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-aether-provider-3.0.4.jar 2019-11-25T09:39:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-impl-1.13.1.jar 2019-11-25T09:39:52.991 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-spi-1.13.1.jar 2019-11-25T09:39:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-util-1.13.1.jar 2019-11-25T09:39:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-api-1.13.1.jar 2019-11-25T09:39:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-provider-api-2.4.jar 2019-11-25T09:39:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-classworlds-2.4.jar 2019-11-25T09:39:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-builder-3.0.4.jar 2019-11-25T09:39:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-3.0.4.jar 2019-11-25T09:39:52.992 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-builder-3.0.4.jar 2019-11-25T09:39:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-artifact-3.0.4.jar 2019-11-25T09:39:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-3.0.4.jar 2019-11-25T09:39:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-sec-dispatcher-1.3.jar 2019-11-25T09:39:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-repository-metadata-3.0.4.jar 2019-11-25T09:39:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-utils-3.0.8.jar 2019-11-25T09:39:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ion-java-1.0.2.jar 2019-11-25T09:39:52.993 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpcore-4.4.9.jar 2019-11-25T09:39:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/hamcrest-core-1.3.jar 2019-11-25T09:39:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-engine-1.0.3.jar 2019-11-25T09:39:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-commons-1.0.3.jar 2019-11-25T09:39:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/apiguardian-api-1.0.0.jar 2019-11-25T09:39:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcommander-1.47.jar 2019-11-25T09:39:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-interpolation-1.14.jar 2019-11-25T09:39:52.994 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-component-annotations-1.5.5.jar 2019-11-25T09:39:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/opentest4j-1.0.0.jar 2019-11-25T09:39:52.995 INFO:teuthology.orchestra.run.smithi135.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-cipher-1.7.jar 2019-11-25T09:39:52.995 INFO:teuthology.orchestra.run.smithi135.stdout:export PATH=/opt/gradle/gradle-4.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin 2019-11-25T09:39:53.843 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:39:53.843 INFO:teuthology.orchestra.run.smithi135.stdout:Welcome to Gradle 4.7! 2019-11-25T09:39:53.843 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:39:53.843 INFO:teuthology.orchestra.run.smithi135.stdout:Here are the highlights of this release: 2019-11-25T09:39:53.843 INFO:teuthology.orchestra.run.smithi135.stdout: - Incremental annotation processing 2019-11-25T09:39:53.844 INFO:teuthology.orchestra.run.smithi135.stdout: - JDK 10 support 2019-11-25T09:39:53.844 INFO:teuthology.orchestra.run.smithi135.stdout: - Grouped non-interactive console logs 2019-11-25T09:39:53.844 INFO:teuthology.orchestra.run.smithi135.stdout: - Failed tests are re-run first for quicker feedback 2019-11-25T09:39:53.844 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:39:53.844 INFO:teuthology.orchestra.run.smithi135.stdout:For more details see https://docs.gradle.org/4.7/release-notes.html 2019-11-25T09:39:53.844 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:39:54.187 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:39:54.187 INFO:teuthology.orchestra.run.smithi135.stdout:------------------------------------------------------------ 2019-11-25T09:39:54.187 INFO:teuthology.orchestra.run.smithi135.stdout:Gradle 4.7 2019-11-25T09:39:54.187 INFO:teuthology.orchestra.run.smithi135.stdout:------------------------------------------------------------ 2019-11-25T09:39:54.187 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:39:54.187 INFO:teuthology.orchestra.run.smithi135.stdout:Build time: 2018-04-18 09:09:12 UTC 2019-11-25T09:39:54.188 INFO:teuthology.orchestra.run.smithi135.stdout:Revision: b9a962bf70638332300e7f810689cb2febbd4a6c 2019-11-25T09:39:54.188 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:39:54.188 INFO:teuthology.orchestra.run.smithi135.stdout:Groovy: 2.4.12 2019-11-25T09:39:54.188 INFO:teuthology.orchestra.run.smithi135.stdout:Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 2019-11-25T09:39:54.188 INFO:teuthology.orchestra.run.smithi135.stdout:JVM: 1.8.0_232 (Oracle Corporation 25.232-b09) 2019-11-25T09:39:54.188 INFO:teuthology.orchestra.run.smithi135.stdout:OS: Linux 3.10.0-1062.4.3.el7.x86_64 amd64 2019-11-25T09:39:54.188 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:39:54.197 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2019-11-25T09:39:54.197 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-11-25T09:39:54.197 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi174.front.sepia.ceph.com 2019-11-25T09:39:54.198 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-11-25T09:39:54.198 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi135.front.sepia.ceph.com 2019-11-25T09:39:54.198 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2019-11-25T09:39:54.601 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2019-11-25T09:39:54.601 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2019-11-25T09:39:54.602 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'HQGSPUWQIVCRYKGLHGOV', 's3dir': 'folder', 'endpoint': 'smithi135.front.sepia.ceph.com:80', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 80, 'access_secret': '9s15Cv5eA0wYs8n/+7mje2dP+zSvoxmlApR4ernbgFkWNT3wOiuEqw==', 'host': 'smithi135.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': False, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2019-11-25T09:39:54.602 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2019-11-25T09:39:54.602 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'HQGSPUWQIVCRYKGLHGOV', '--secret', '9s15Cv5eA0wYs8n/+7mje2dP+zSvoxmlApR4ernbgFkWNT3wOiuEqw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2019-11-25T09:39:54.603 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key HQGSPUWQIVCRYKGLHGOV --secret 9s15Cv5eA0wYs8n/+7mje2dP+zSvoxmlApR4ernbgFkWNT3wOiuEqw== --email tester.client.0_test@test.test --cluster ceph 2019-11-25T09:39:54.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.657+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.683+0000 7f3126778ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:54.752 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.683+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:54.758 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.690+0000 7f3126778ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:54.759 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.690+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.695+0000 7f3126778ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.695+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:54.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.715+0000 7f3126778ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:54.996 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.928+0000 7f3126778ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T09:39:54.997 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.928+0000 7f3126778ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T09:39:54.997 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.928+0000 7f3126778ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T09:39:54.997 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.928+0000 7f3126778ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T09:39:54.997 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.928+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.011 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.943+0000 7f3126778ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:55.011 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.943+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.031 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.963+0000 7f3126778ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:39:55.031 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.963+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.051 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.983+0000 7f3126778ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:55.051 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.983+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.065 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.997+0000 7f3126778ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:39:55.065 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:54.997+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.074 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.006+0000 7f3126778ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:55.074 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.006+0000 7f3126778ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T09:39:55.074 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.006+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.014+0000 7f3126778ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.014+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.097 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.029+0000 7f3126778ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:55.097 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.029+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.110 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.042+0000 7f3126778ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:39:55.110 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.042+0000 7f3126778ec0 20 zonegroup default 2019-11-25T09:39:55.111 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.042+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.118 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.051+0000 7f3126778ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:55.119 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.051+0000 7f3126778ec0 10 Cannot find current period zone using local zone 2019-11-25T09:39:55.119 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.051+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.126 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.058+0000 7f3126778ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:55.126 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.058+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.148 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.080+0000 7f3126778ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:55.148 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.080+0000 7f3126778ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:55.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.094+0000 7f3126778ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:39:55.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.094+0000 7f3126778ec0 20 zone default found 2019-11-25T09:39:55.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.094+0000 7f3126778ec0 20 started sync module instance, tier type = 2019-11-25T09:39:55.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.094+0000 7f3126778ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T09:39:55.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.425+0000 7f3126778ec0 20 add_watcher() i=0 2019-11-25T09:39:55.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.425+0000 7f3126778ec0 20 add_watcher() i=1 2019-11-25T09:39:55.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.425+0000 7f3126778ec0 20 add_watcher() i=2 2019-11-25T09:39:55.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.425+0000 7f3126778ec0 20 add_watcher() i=3 2019-11-25T09:39:55.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.425+0000 7f3126778ec0 20 add_watcher() i=4 2019-11-25T09:39:55.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.425+0000 7f3126778ec0 20 add_watcher() i=5 2019-11-25T09:39:55.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.425+0000 7f3126778ec0 20 add_watcher() i=6 2019-11-25T09:39:55.522 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.454+0000 7f3126778ec0 20 add_watcher() i=7 2019-11-25T09:39:55.522 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.454+0000 7f3126778ec0 2 all 8 watchers are set, enabling cache 2019-11-25T09:39:55.522 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.454+0000 7f3067fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T09:39:55.529 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.462+0000 7f31141a7700 0 -- 172.21.15.135:0/1977829633 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5578434da480 msgr2=0x5578434da890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T09:39:55.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:55.520+0000 7f31141a7700 0 -- 172.21.15.135:0/3293802046 >> [v2:172.21.15.174:6800/8260,v1:172.21.15.174:6801/8260] conn(0x7f3054017570 msgr2=0x7f3054019a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T09:39:57.316 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.248+0000 7f30527fc700 20 reqs_thread_entry: start 2019-11-25T09:39:57.317 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.248+0000 7f304bfff700 20 reqs_thread_entry: start 2019-11-25T09:39:57.317 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.248+0000 7f3126778ec0 20 init_complete bucket index max shards: 0 2019-11-25T09:39:57.317 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.249+0000 7f304a7fc700 20 reqs_thread_entry: start 2019-11-25T09:39:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.249+0000 7f3126778ec0 20 get_system_obj_state: rctx=0x7ffdaad73db8 obj=default.rgw.meta:users.uid:tester.client.0 state=0x55784355bf70 s->prefetch_data=0 2019-11-25T09:39:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.249+0000 7f3126778ec0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2019-11-25T09:39:57.328 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.260+0000 7f3126778ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2019-11-25T09:39:57.328 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.260+0000 7f3126778ec0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-25T09:39:57.328 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.260+0000 7f3126778ec0 20 get_system_obj_state: rctx=0x7ffdaad73dc8 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x55784355dd00 s->prefetch_data=0 2019-11-25T09:39:57.328 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.260+0000 7f3126778ec0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2019-11-25T09:39:57.338 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.270+0000 7f3126778ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2019-11-25T09:39:57.338 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.270+0000 7f3126778ec0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-25T09:39:57.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.270+0000 7f3126778ec0 20 get_system_obj_state: rctx=0x7ffdaad73dc8 obj=default.rgw.meta:users.keys:HQGSPUWQIVCRYKGLHGOV state=0x55784355dd00 s->prefetch_data=0 2019-11-25T09:39:57.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.270+0000 7f3126778ec0 10 cache get: name=default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV : miss 2019-11-25T09:39:57.347 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.278+0000 7f3126778ec0 10 cache put: name=default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV info.flags=0x0 2019-11-25T09:39:57.347 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.278+0000 7f3126778ec0 10 adding default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV to cache LRU end 2019-11-25T09:39:57.347 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.278+0000 7f3126778ec0 20 get_system_obj_state: rctx=0x7ffdaad739d8 obj=default.rgw.meta:users.keys:HQGSPUWQIVCRYKGLHGOV state=0x55784355dd00 s->prefetch_data=0 2019-11-25T09:39:57.347 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.278+0000 7f3126778ec0 10 cache get: name=default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV : type miss (requested=0x6, cached=0x0) 2019-11-25T09:39:57.354 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.285+0000 7f3126778ec0 10 cache put: name=default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV info.flags=0x0 2019-11-25T09:39:57.354 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.285+0000 7f3126778ec0 10 moving default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV to cache LRU end 2019-11-25T09:39:57.354 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.285+0000 7f3126778ec0 20 get_system_obj_state: rctx=0x7ffdaad73b58 obj=default.rgw.meta:users.keys:HQGSPUWQIVCRYKGLHGOV state=0x55784355dd00 s->prefetch_data=0 2019-11-25T09:39:57.354 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.285+0000 7f3126778ec0 10 cache get: name=default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV : type miss (requested=0x6, cached=0x0) 2019-11-25T09:39:57.362 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.294+0000 7f3126778ec0 10 cache put: name=default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV info.flags=0x0 2019-11-25T09:39:57.363 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.294+0000 7f3126778ec0 10 moving default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV to cache LRU end 2019-11-25T09:39:57.412 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.344+0000 7f3126778ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-25T09:39:57.412 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.344+0000 7f3126778ec0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-25T09:39:57.413 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.344+0000 7f3126778ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2019-11-25T09:39:57.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.389+0000 7f31097fa700 10 RGWWatcher::handle_notify() notify_id 575525617664 cookie 93975013529312 notifier 4493 bl.length()=632 2019-11-25T09:39:57.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.390+0000 7f31097fa700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-11-25T09:39:57.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.390+0000 7f31097fa700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-11-25T09:39:57.840 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.772+0000 7f3126778ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-25T09:39:57.841 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.772+0000 7f3126778ec0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-25T09:39:57.841 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.772+0000 7f3126778ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2019-11-25T09:39:57.863 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.795+0000 7f31097fa700 10 RGWWatcher::handle_notify() notify_id 575525617673 cookie 93975013525456 notifier 4493 bl.length()=200 2019-11-25T09:39:57.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.795+0000 7f31097fa700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-11-25T09:39:57.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:57.795+0000 7f31097fa700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-11-25T09:39:58.454 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.386+0000 7f3126778ec0 10 cache put: name=default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV info.flags=0x7 2019-11-25T09:39:58.454 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.386+0000 7f3126778ec0 10 moving default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV to cache LRU end 2019-11-25T09:39:58.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.386+0000 7f3126778ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=189 2019-11-25T09:39:58.472 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.404+0000 7f31097fa700 10 RGWWatcher::handle_notify() notify_id 575525617673 cookie 93975013531456 notifier 4493 bl.length()=189 2019-11-25T09:39:58.472 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.404+0000 7f31097fa700 10 cache put: name=default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV info.flags=0x7 2019-11-25T09:39:58.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.404+0000 7f31097fa700 10 moving default.rgw.meta+users.keys+HQGSPUWQIVCRYKGLHGOV to cache LRU end 2019-11-25T09:39:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2019-11-25T09:39:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "user_id": "tester.client.0", 2019-11-25T09:39:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "display_name": "Ms. tester.client.0", 2019-11-25T09:39:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "email": "tester.client.0_test@test.test", 2019-11-25T09:39:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "suspended": 0, 2019-11-25T09:39:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "max_buckets": 1000, 2019-11-25T09:39:58.616 INFO:teuthology.orchestra.run.smithi135.stdout: "subusers": [], 2019-11-25T09:39:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "keys": [ 2019-11-25T09:39:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2019-11-25T09:39:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "user": "tester.client.0", 2019-11-25T09:39:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "access_key": "HQGSPUWQIVCRYKGLHGOV", 2019-11-25T09:39:58.617 INFO:teuthology.orchestra.run.smithi135.stdout: "secret_key": "9s15Cv5eA0wYs8n/+7mje2dP+zSvoxmlApR4ernbgFkWNT3wOiuEqw==" 2019-11-25T09:39:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: } 2019-11-25T09:39:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2019-11-25T09:39:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "swift_keys": [], 2019-11-25T09:39:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": [], 2019-11-25T09:39:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "op_mask": "read, write, delete", 2019-11-25T09:39:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "default_placement": "", 2019-11-25T09:39:58.618 INFO:teuthology.orchestra.run.smithi135.stdout: "default_storage_class": "", 2019-11-25T09:39:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "placement_tags": [], 2019-11-25T09:39:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "bucket_quota": { 2019-11-25T09:39:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T09:39:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T09:39:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T09:39:58.619 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T09:39:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T09:39:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T09:39:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "user_quota": { 2019-11-25T09:39:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T09:39:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T09:39:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T09:39:58.620 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T09:39:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T09:39:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T09:39:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "temp_url_keys": [], 2019-11-25T09:39:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "rgw", 2019-11-25T09:39:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: "mfa_ids": [] 2019-11-25T09:39:58.621 INFO:teuthology.orchestra.run.smithi135.stdout:} 2019-11-25T09:39:58.621 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:39:58.667 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.598+0000 7f3126778ec0 20 remove_watcher() i=0 2019-11-25T09:39:58.667 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.598+0000 7f3126778ec0 2 removed watcher, disabling cache 2019-11-25T09:39:58.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.653+0000 7f3126778ec0 20 remove_watcher() i=1 2019-11-25T09:39:58.777 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.708+0000 7f3126778ec0 20 remove_watcher() i=2 2019-11-25T09:39:58.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.752+0000 7f3126778ec0 20 remove_watcher() i=3 2019-11-25T09:39:58.867 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.798+0000 7f3126778ec0 20 remove_watcher() i=4 2019-11-25T09:39:58.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.846+0000 7f3126778ec0 20 remove_watcher() i=5 2019-11-25T09:39:58.970 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.901+0000 7f3126778ec0 20 remove_watcher() i=6 2019-11-25T09:39:59.032 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:58.963+0000 7f3126778ec0 20 remove_watcher() i=7 2019-11-25T09:39:59.045 INFO:teuthology.orchestra.run.smithi135:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2019-11-25T09:39:59.117 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2019-11-25T09:39:59.118 INFO:teuthology.orchestra.run.smithi135:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2019-11-25T09:39:59.196 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T09:39:59.315 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.246+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.343 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.275+0000 7f34c8ec7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:59.344 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.275+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.352 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.284+0000 7f34c8ec7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:59.352 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.284+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.363 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.295+0000 7f34c8ec7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:59.363 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.295+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.315+0000 7f34c8ec7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:59.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.496+0000 7f34c8ec7ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T09:39:59.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.496+0000 7f34c8ec7ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T09:39:59.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.496+0000 7f34c8ec7ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T09:39:59.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.496+0000 7f34c8ec7ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T09:39:59.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.496+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.573 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.505+0000 7f34c8ec7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:59.573 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.505+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.587 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.519+0000 7f34c8ec7ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:39:59.587 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.519+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.597 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.529+0000 7f34c8ec7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:59.597 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.529+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.615 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.546+0000 7f34c8ec7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:39:59.615 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.546+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.554+0000 7f34c8ec7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:59.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.554+0000 7f34c8ec7ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T09:39:59.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.554+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.630 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.561+0000 7f34c8ec7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:59.630 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.561+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.641 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.573+0000 7f34c8ec7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:59.641 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.573+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.590+0000 7f34c8ec7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:39:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.590+0000 7f34c8ec7ec0 20 zonegroup default 2019-11-25T09:39:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.590+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.665 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.597+0000 7f34c8ec7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:59.666 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.597+0000 7f34c8ec7ec0 10 Cannot find current period zone using local zone 2019-11-25T09:39:59.666 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.597+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.606+0000 7f34c8ec7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:39:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.606+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.684 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.616+0000 7f34c8ec7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:39:59.685 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.616+0000 7f34c8ec7ec0 20 rados->read ofs=0 len=0 2019-11-25T09:39:59.695 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.626+0000 7f34c8ec7ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:39:59.695 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.626+0000 7f34c8ec7ec0 20 zone default found 2019-11-25T09:39:59.695 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.626+0000 7f34c8ec7ec0 20 started sync module instance, tier type = 2019-11-25T09:39:59.695 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:39:59.626+0000 7f34c8ec7ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T09:40:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.003+0000 7f34c8ec7ec0 20 add_watcher() i=0 2019-11-25T09:40:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.003+0000 7f34c8ec7ec0 20 add_watcher() i=1 2019-11-25T09:40:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.003+0000 7f34c8ec7ec0 20 add_watcher() i=2 2019-11-25T09:40:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.003+0000 7f34c8ec7ec0 20 add_watcher() i=3 2019-11-25T09:40:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.003+0000 7f34c8ec7ec0 20 add_watcher() i=4 2019-11-25T09:40:00.073 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.003+0000 7f34c8ec7ec0 20 add_watcher() i=5 2019-11-25T09:40:00.073 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.003+0000 7f34c8ec7ec0 20 add_watcher() i=6 2019-11-25T09:40:00.097 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.029+0000 7f34c8ec7ec0 20 add_watcher() i=7 2019-11-25T09:40:00.097 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.029+0000 7f34c8ec7ec0 2 all 8 watchers are set, enabling cache 2019-11-25T09:40:00.097 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.029+0000 7f3486fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T09:40:00.105 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.036+0000 7f34affff700 0 -- 172.21.15.135:0/1696826765 >> v2:172.21.15.135:3300/0 conn(0x55934cbd9f30 msgr2=0x55934cbdc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T09:40:00.139 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:00.070+0000 7f34b60f5700 0 -- 172.21.15.135:0/4221459557 >> [v2:172.21.15.174:6800/8260,v1:172.21.15.174:6801/8260] conn(0x7f33f80197f0 msgr2=0x7f33f801bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T09:40:01.501 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.432+0000 7f33f57fa700 20 reqs_thread_entry: start 2019-11-25T09:40:01.501 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.432+0000 7f33eeffd700 20 reqs_thread_entry: start 2019-11-25T09:40:01.501 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.432+0000 7f34c8ec7ec0 20 init_complete bucket index max shards: 0 2019-11-25T09:40:01.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.433+0000 7f33ed7fa700 20 reqs_thread_entry: start 2019-11-25T09:40:01.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.433+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T09:40:01.580 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.511+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:01.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.536+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:01.640 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.571+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T09:40:01.640 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.571+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_d5vGHTAYf6DRXxs9ADA_m1U47Ht0Bqj', time=2019-11-25T11:39:22.723605+0000, chain.objs.size()=2 2019-11-25T09:40:01.640 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.571+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.IrqkKyI7fKwM_UhNYO8yNS87P0pCaxs_0 2019-11-25T09:40:01.640 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.571+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.IrqkKyI7fKwM_UhNYO8yNS87P0pCaxs_1 2019-11-25T09:40:01.640 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.571+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_k-m0zctAoLgcQpdrywRNCHmEXjooYZ4', time=2019-11-25T11:39:24.588403+0000, chain.objs.size()=1 2019-11-25T09:40:01.641 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.571+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.qcVLy2EQuiuE2_mhyYlrpjWm7LhYDzu_0 2019-11-25T09:40:01.733 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.665+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.771+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T09:40:01.892 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.823+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:01.918 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.849+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:01.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.859+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:01.960 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.892+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T09:40:02.008 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.939+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:02.030 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.962+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:02.043 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:01.975+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:02.083 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.014+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T09:40:02.159 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.090+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:02.196 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.127+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:02.208 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.139+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:02.249 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.180+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T09:40:02.350 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.281+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:02.381 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.312+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:02.399 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.330+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:02.457 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.389+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T09:40:02.519 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.450+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:02.538 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.469+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:02.578 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T09:40:02.578 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.224', time=2019-11-25T11:39:27.026306+0000, chain.objs.size()=5 2019-11-25T09:40:02.578 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-FROZEN.2~o_lFX7fdp39xgT1PZu1467I0plGvXjQ.1 2019-11-25T09:40:02.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_foo-FROZEN.2~o_lFX7fdp39xgT1PZu1467I0plGvXjQ.1_1 2019-11-25T09:40:02.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-FROZEN.2~o_lFX7fdp39xgT1PZu1467I0plGvXjQ.2 2019-11-25T09:40:02.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_foo-FROZEN.2~o_lFX7fdp39xgT1PZu1467I0plGvXjQ.2_1 2019-11-25T09:40:02.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-FROZEN.2~o_lFX7fdp39xgT1PZu1467I0plGvXjQ.3 2019-11-25T09:40:02.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.85', time=2019-11-25T11:39:33.580762+0000, chain.objs.size()=3 2019-11-25T09:40:02.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6__shadow_.802ohvRfdglZZjNqNWhRublzYqQttHI_0 2019-11-25T09:40:02.580 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6__shadow_.802ohvRfdglZZjNqNWhRublzYqQttHI_1 2019-11-25T09:40:02.580 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.508+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6__shadow_.802ohvRfdglZZjNqNWhRublzYqQttHI_2 2019-11-25T09:40:02.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.685+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:02.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.819+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T09:40:02.946 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.876+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:02.966 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.896+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:02.977 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.907+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:03.012 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.942+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T09:40:03.054 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:02.984+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:03.070 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.000+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:03.079 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.009+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:03.117 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.043+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T09:40:03.152 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.082+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:03.176 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.107+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:03.187 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.117+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:03.233 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.163+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T09:40:03.315 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.245+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:03.346 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.277+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:03.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T09:40:03.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.71', time=2019-11-25T11:39:20.598327+0000, chain.objs.size()=7 2019-11-25T09:40:03.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5__multipart_foo.2~aiAVmSDXn_NQmx_nxO6X6ZbPo2_ZLqP.1 2019-11-25T09:40:03.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5__shadow_foo.2~aiAVmSDXn_NQmx_nxO6X6ZbPo2_ZLqP.1_1 2019-11-25T09:40:03.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5__multipart_foo.2~aiAVmSDXn_NQmx_nxO6X6ZbPo2_ZLqP.2 2019-11-25T09:40:03.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5__shadow_foo.2~aiAVmSDXn_NQmx_nxO6X6ZbPo2_ZLqP.2_1 2019-11-25T09:40:03.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5__multipart_foo.2~aiAVmSDXn_NQmx_nxO6X6ZbPo2_ZLqP.3 2019-11-25T09:40:03.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5__shadow_foo.2~aiAVmSDXn_NQmx_nxO6X6ZbPo2_ZLqP.3_1 2019-11-25T09:40:03.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.5__multipart_foo.2~aiAVmSDXn_NQmx_nxO6X6ZbPo2_ZLqP.4 2019-11-25T09:40:03.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.210', time=2019-11-25T11:39:31.884366+0000, chain.objs.size()=3 2019-11-25T09:40:03.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__multipart_foo-STANDARD.2~OKrQhdOVNZgKqHytLedFoLFAcbJk2fx.1 2019-11-25T09:40:03.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__multipart_foo-STANDARD.2~OKrQhdOVNZgKqHytLedFoLFAcbJk2fx.2 2019-11-25T09:40:03.402 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.330+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__multipart_foo-STANDARD.2~OKrQhdOVNZgKqHytLedFoLFAcbJk2fx.3 2019-11-25T09:40:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.826+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:04.021 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:03.951+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T09:40:04.071 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.001+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:04.096 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.023+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:04.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.084+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T09:40:04.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.084+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.112', time=2019-11-25T11:39:23.142933+0000, chain.objs.size()=2 2019-11-25T09:40:04.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.084+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.EC_41CPQxzyYkOhFNRJcmj8qZOZKCDR_0 2019-11-25T09:40:04.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.084+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.EC_41CPQxzyYkOhFNRJcmj8qZOZKCDR_1 2019-11-25T09:40:04.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.084+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.114', time=2019-11-25T11:39:23.668937+0000, chain.objs.size()=2 2019-11-25T09:40:04.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.084+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.EC_41CPQxzyYkOhFNRJcmj8qZOZKCDR_0 2019-11-25T09:40:04.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.084+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.EC_41CPQxzyYkOhFNRJcmj8qZOZKCDR_1 2019-11-25T09:40:04.348 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.278+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:04.525 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.455+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T09:40:04.577 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.507+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:04.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.534+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:04.616 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.546+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:04.661 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.591+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T09:40:04.745 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.675+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:04.772 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.703+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:04.821 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.751+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T09:40:04.821 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.751+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_DoWKPEtQJlcyuYFKgiVS9MSvI9tgGWa', time=2019-11-25T11:39:23.507714+0000, chain.objs.size()=2 2019-11-25T09:40:04.821 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.751+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.XC71ONMiX7r4jgXjsxLqh4HwJwpr9YE_0 2019-11-25T09:40:04.821 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.751+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.XC71ONMiX7r4jgXjsxLqh4HwJwpr9YE_1 2019-11-25T09:40:04.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.751+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.242', time=2019-11-25T11:39:28.983147+0000, chain.objs.size()=3 2019-11-25T09:40:04.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.751+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-STANDARD.2~0m5feZEZz7BxCWu-SDXuy4eO_bmo4sw.1 2019-11-25T09:40:04.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.751+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-STANDARD.2~0m5feZEZz7BxCWu-SDXuy4eO_bmo4sw.2 2019-11-25T09:40:04.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.751+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-STANDARD.2~0m5feZEZz7BxCWu-SDXuy4eO_bmo4sw.3 2019-11-25T09:40:04.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:04.918+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:05.099 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.028+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T09:40:05.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.086+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:05.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.114+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:05.198 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.129+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:05.239 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.171+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T09:40:05.319 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.250+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:05.349 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.280+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:05.362 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.293+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:05.416 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.347+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T09:40:05.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.404+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:05.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.427+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:05.525 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T09:40:05.526 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.20', time=2019-11-25T11:39:14.963695+0000, chain.objs.size()=7 2019-11-25T09:40:05.526 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2__multipart_foo.2~8cS0LNTGG-I1Lmm98N5OG75HeyXu4aI.1 2019-11-25T09:40:05.526 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2__shadow_foo.2~8cS0LNTGG-I1Lmm98N5OG75HeyXu4aI.1_1 2019-11-25T09:40:05.526 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2__multipart_foo.2~8cS0LNTGG-I1Lmm98N5OG75HeyXu4aI.2 2019-11-25T09:40:05.526 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2__shadow_foo.2~8cS0LNTGG-I1Lmm98N5OG75HeyXu4aI.2_1 2019-11-25T09:40:05.526 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2__multipart_foo.2~8cS0LNTGG-I1Lmm98N5OG75HeyXu4aI.3 2019-11-25T09:40:05.527 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2__shadow_foo.2~8cS0LNTGG-I1Lmm98N5OG75HeyXu4aI.3_1 2019-11-25T09:40:05.527 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.2__multipart_foo.2~8cS0LNTGG-I1Lmm98N5OG75HeyXu4aI.4 2019-11-25T09:40:05.527 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.109', time=2019-11-25T11:39:22.543079+0000, chain.objs.size()=2 2019-11-25T09:40:05.527 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.SKydq27HQYOLmm68so2Ei7T3uYcbQrC_0 2019-11-25T09:40:05.527 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.446+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.SKydq27HQYOLmm68so2Ei7T3uYcbQrC_1 2019-11-25T09:40:05.800 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.731+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:05.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.824+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T09:40:05.931 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.862+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:05.948 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.879+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:05.958 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.889+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:05.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.921+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T09:40:06.029 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.961+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:06.044 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:05.976+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.023+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T09:40:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.023+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.40', time=2019-11-25T11:39:16.471251+0000, chain.objs.size()=4 2019-11-25T09:40:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.023+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3__multipart_foo.2~19ZsRdNDqDToEH7idVaNktw1KLeXC9Z.1 2019-11-25T09:40:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.023+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3__multipart_foo.2~19ZsRdNDqDToEH7idVaNktw1KLeXC9Z.2 2019-11-25T09:40:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.023+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3__multipart_foo.2~19ZsRdNDqDToEH7idVaNktw1KLeXC9Z.3 2019-11-25T09:40:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.023+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.3__multipart_foo.2~19ZsRdNDqDToEH7idVaNktw1KLeXC9Z.4 2019-11-25T09:40:06.322 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.253+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:06.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.399+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T09:40:06.533 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.464+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:06.551 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.482+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:06.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.497+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T09:40:06.567 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.497+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_tzTZTgsZHGfuUKhf9c9yMYvQ7q2G5sl', time=2019-11-25T11:39:29.567254+0000, chain.objs.size()=1 2019-11-25T09:40:06.567 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.498+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.5aF7Cjtb3TqwBIDO-j0wUsOgjJ5GV_r_0 2019-11-25T09:40:06.611 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.542+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:06.693 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.624+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T09:40:06.733 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.664+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:06.749 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.680+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:06.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.692+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T09:40:06.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.692+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.203', time=2019-11-25T11:39:31.753351+0000, chain.objs.size()=5 2019-11-25T09:40:06.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.692+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__multipart_foo-LUKEWARM.2~Z3qvQpskAE7dUyF1ZnnQaGh96h4MsG3.1 2019-11-25T09:40:06.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.692+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__shadow_foo-LUKEWARM.2~Z3qvQpskAE7dUyF1ZnnQaGh96h4MsG3.1_1 2019-11-25T09:40:06.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.692+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__multipart_foo-LUKEWARM.2~Z3qvQpskAE7dUyF1ZnnQaGh96h4MsG3.2 2019-11-25T09:40:06.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.692+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__shadow_foo-LUKEWARM.2~Z3qvQpskAE7dUyF1ZnnQaGh96h4MsG3.2_1 2019-11-25T09:40:06.763 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.692+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__multipart_foo-LUKEWARM.2~Z3qvQpskAE7dUyF1ZnnQaGh96h4MsG3.3 2019-11-25T09:40:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.787+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:06.917 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.848+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T09:40:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.895+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:06.983 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.915+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.924+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:06.964+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T09:40:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.034+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.059+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:07.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.092+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T09:40:07.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.092+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.225', time=2019-11-25T11:39:27.324341+0000, chain.objs.size()=5 2019-11-25T09:40:07.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.092+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-FROZEN.2~o_lFX7fdp39xgT1PZu1467I0plGvXjQ.1 2019-11-25T09:40:07.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.092+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_foo-FROZEN.2~o_lFX7fdp39xgT1PZu1467I0plGvXjQ.1_1 2019-11-25T09:40:07.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.092+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-FROZEN.2~o_lFX7fdp39xgT1PZu1467I0plGvXjQ.2 2019-11-25T09:40:07.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.092+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_foo-FROZEN.2~o_lFX7fdp39xgT1PZu1467I0plGvXjQ.2_1 2019-11-25T09:40:07.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.092+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-FROZEN.2~o_lFX7fdp39xgT1PZu1467I0plGvXjQ.3 2019-11-25T09:40:07.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.092+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.84', time=2019-11-25T11:39:33.289092+0000, chain.objs.size()=3 2019-11-25T09:40:07.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.092+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6__shadow_.AKTmrMZNVHt624X4LzNacBkWX6HmGvk_0 2019-11-25T09:40:07.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.093+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6__shadow_.AKTmrMZNVHt624X4LzNacBkWX6HmGvk_1 2019-11-25T09:40:07.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.093+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.6__shadow_.AKTmrMZNVHt624X4LzNacBkWX6HmGvk_2 2019-11-25T09:40:07.330 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.261+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:07.438 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.369+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T09:40:07.510 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.441+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:07.531 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.462+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:07.571 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.501+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T09:40:07.571 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.501+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.235', time=2019-11-25T11:39:28.544573+0000, chain.objs.size()=5 2019-11-25T09:40:07.571 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.501+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-LUKEWARM.2~BETl4NtFA9ungSArHIds8PRsEXjfOZD.1 2019-11-25T09:40:07.571 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.501+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_foo-LUKEWARM.2~BETl4NtFA9ungSArHIds8PRsEXjfOZD.1_1 2019-11-25T09:40:07.571 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.502+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-LUKEWARM.2~BETl4NtFA9ungSArHIds8PRsEXjfOZD.2 2019-11-25T09:40:07.571 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.502+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_foo-LUKEWARM.2~BETl4NtFA9ungSArHIds8PRsEXjfOZD.2_1 2019-11-25T09:40:07.572 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.502+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-LUKEWARM.2~BETl4NtFA9ungSArHIds8PRsEXjfOZD.3 2019-11-25T09:40:07.644 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.575+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:07.740 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.670+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T09:40:07.814 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.745+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:07.857 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.788+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:07.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T09:40:07.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.245', time=2019-11-25T11:39:29.864373+0000, chain.objs.size()=3 2019-11-25T09:40:07.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-STANDARD.2~0m5feZEZz7BxCWu-SDXuy4eO_bmo4sw.1 2019-11-25T09:40:07.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-STANDARD.2~0m5feZEZz7BxCWu-SDXuy4eO_bmo4sw.2 2019-11-25T09:40:07.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-STANDARD.2~0m5feZEZz7BxCWu-SDXuy4eO_bmo4sw.3 2019-11-25T09:40:07.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.196', time=2019-11-25T11:39:31.495130+0000, chain.objs.size()=5 2019-11-25T09:40:07.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__multipart_foo-FROZEN.2~vOClW7FrlapyUVBo0pD96LX7z4pJmzu.1 2019-11-25T09:40:07.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__shadow_foo-FROZEN.2~vOClW7FrlapyUVBo0pD96LX7z4pJmzu.1_1 2019-11-25T09:40:07.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__multipart_foo-FROZEN.2~vOClW7FrlapyUVBo0pD96LX7z4pJmzu.2 2019-11-25T09:40:07.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__shadow_foo-FROZEN.2~vOClW7FrlapyUVBo0pD96LX7z4pJmzu.2_1 2019-11-25T09:40:07.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:07.817+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.8__multipart_foo-FROZEN.2~vOClW7FrlapyUVBo0pD96LX7z4pJmzu.3 2019-11-25T09:40:08.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.225+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:08.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.332+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T09:40:08.444 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.375+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:08.462 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.393+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:08.474 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.405+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T09:40:08.475 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.405+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_ecaxEbyMn8gbNKst_yVvr4Q0aChGie7', time=2019-11-25T11:39:27.627019+0000, chain.objs.size()=3 2019-11-25T09:40:08.475 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.405+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.mDx11ZVpiZxdPtJZwQpDWAEnyxTE_cv_0 2019-11-25T09:40:08.475 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.405+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.mDx11ZVpiZxdPtJZwQpDWAEnyxTE_cv_1 2019-11-25T09:40:08.475 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.405+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.mDx11ZVpiZxdPtJZwQpDWAEnyxTE_cv_2 2019-11-25T09:40:08.564 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.494+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:08.629 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.560+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T09:40:08.668 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.599+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:08.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.613+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:08.692 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.623+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T09:40:08.693 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.623+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_Do0HoFVsb4c7w20UVOJSdYfnE-RAtBP', time=2019-11-25T11:39:29.125077+0000, chain.objs.size()=1 2019-11-25T09:40:08.693 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.623+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.5cawx7wWknJSQli_UuW6qS7Y26QSE3L_0 2019-11-25T09:40:08.758 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.689+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:08.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.802+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T09:40:08.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.868+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:08.953 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.885+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:08.964 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.895+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T09:40:08.965 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.895+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_Jlww8F6eNpgNVU4-U7uqxyQlZtgQGUI', time=2019-11-25T11:39:24.746228+0000, chain.objs.size()=1 2019-11-25T09:40:08.965 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.895+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.oyxyipwNyIHQAGyM5RN8N2QzC7VlCVj_0 2019-11-25T09:40:09.043 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:08.974+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:09.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.093+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T09:40:09.244 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.175+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:09.273 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.203+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:09.295 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-25T09:40:09.296 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_bx7C3PtD7kBHShvR2NoHoAuFrvKIv1O', time=2019-11-25T11:39:27.876252+0000, chain.objs.size()=2 2019-11-25T09:40:09.296 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.pl6FYl7PO7M8XlJzmOk06VO_DAdQJD7_1 2019-11-25T09:40:09.296 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.pl6FYl7PO7M8XlJzmOk06VO_DAdQJD7_2 2019-11-25T09:40:09.296 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.233', time=2019-11-25T11:39:28.125457+0000, chain.objs.size()=5 2019-11-25T09:40:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-LUKEWARM.2~BETl4NtFA9ungSArHIds8PRsEXjfOZD.1 2019-11-25T09:40:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_foo-LUKEWARM.2~BETl4NtFA9ungSArHIds8PRsEXjfOZD.1_1 2019-11-25T09:40:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-LUKEWARM.2~BETl4NtFA9ungSArHIds8PRsEXjfOZD.2 2019-11-25T09:40:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_foo-LUKEWARM.2~BETl4NtFA9ungSArHIds8PRsEXjfOZD.2_1 2019-11-25T09:40:09.297 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__multipart_foo-LUKEWARM.2~BETl4NtFA9ungSArHIds8PRsEXjfOZD.3 2019-11-25T09:40:09.298 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_9Lrh_q6zjtHUFSq6Sw1PMmKI1f4QvbL', time=2019-11-25T11:39:28.373215+0000, chain.objs.size()=3 2019-11-25T09:40:09.298 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.2KIa5cReS6tXxx6LsHi_PZhIxYJl3jK_0 2019-11-25T09:40:09.298 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.2KIa5cReS6tXxx6LsHi_PZhIxYJl3jK_1 2019-11-25T09:40:09.298 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.226+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.2KIa5cReS6tXxx6LsHi_PZhIxYJl3jK_2 2019-11-25T09:40:09.558 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.489+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:09.637 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.567+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T09:40:09.672 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.603+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:09.690 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.621+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:09.699 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.630+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:09.733 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.664+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T09:40:09.773 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.704+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:09.793 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.723+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:09.819 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.736+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T09:40:09.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.737+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.55', time=2019-11-25T11:39:19.367551+0000, chain.objs.size()=4 2019-11-25T09:40:09.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.737+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4__multipart_foo.2~rtzLTcNKS6JP6FTz2BssRJEBCLZJZNk.1 2019-11-25T09:40:09.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.737+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4__multipart_foo.2~rtzLTcNKS6JP6FTz2BssRJEBCLZJZNk.2 2019-11-25T09:40:09.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.737+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4__multipart_foo.2~rtzLTcNKS6JP6FTz2BssRJEBCLZJZNk.3 2019-11-25T09:40:09.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:09.737+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.4__multipart_foo.2~rtzLTcNKS6JP6FTz2BssRJEBCLZJZNk.4 2019-11-25T09:40:10.071 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.002+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:10.137 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.068+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T09:40:10.176 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.106+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:10.191 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.122+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:10.201 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.131+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T09:40:10.201 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.131+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_bFmDVYuK71ndmDV5dZ0yc2qhCSTh_sA', time=2019-11-25T11:39:23.985713+0000, chain.objs.size()=1 2019-11-25T09:40:10.201 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.131+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.rmA2RuCC7K7cfIQu121XtUc1pmd34Nz_1 2019-11-25T09:40:10.272 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.203+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:10.373 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.304+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T09:40:10.423 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.354+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:10.440 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.371+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:10.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.386+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-25T09:40:10.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.386+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.108', time=2019-11-25T11:39:22.232520+0000, chain.objs.size()=2 2019-11-25T09:40:10.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.386+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.SKydq27HQYOLmm68so2Ei7T3uYcbQrC_0 2019-11-25T09:40:10.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.386+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.SKydq27HQYOLmm68so2Ei7T3uYcbQrC_1 2019-11-25T09:40:10.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.386+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_ah3QC4iJUxPEhV_Ho_9DlMPDl14esiC', time=2019-11-25T11:39:22.881488+0000, chain.objs.size()=1 2019-11-25T09:40:10.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.386+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.7__shadow_.-7LFN4aDkjOALYeezjmYHyo6RTPh8M2_1 2019-11-25T09:40:10.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.386+0000 7f34c8ec7ec0 20 garbage collection: RGWGC::process iterating over entry tag='_gyCatk4BnKj_R_bBufA1r3fsQzIt_dn', time=2019-11-25T11:39:28.715829+0000, chain.objs.size()=2 2019-11-25T09:40:10.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.386+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.b-mjKWN7mUVw-Hf9PMH2s6AhBclUKb1_1 2019-11-25T09:40:10.457 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.386+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.9__shadow_.b-mjKWN7mUVw-Hf9PMH2s6AhBclUKb1_2 2019-11-25T09:40:10.630 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.561+0000 7f34c8ec7ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T09:40:10.750 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.680+0000 7f34c8ec7ec0 20 remove_watcher() i=0 2019-11-25T09:40:10.750 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.680+0000 7f34c8ec7ec0 2 removed watcher, disabling cache 2019-11-25T09:40:10.797 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.728+0000 7f34c8ec7ec0 20 remove_watcher() i=1 2019-11-25T09:40:10.837 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.768+0000 7f34c8ec7ec0 20 remove_watcher() i=2 2019-11-25T09:40:10.872 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.803+0000 7f34c8ec7ec0 20 remove_watcher() i=3 2019-11-25T09:40:10.907 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.838+0000 7f34c8ec7ec0 20 remove_watcher() i=4 2019-11-25T09:40:10.942 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.873+0000 7f34c8ec7ec0 20 remove_watcher() i=5 2019-11-25T09:40:10.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.904+0000 7f34c8ec7ec0 20 remove_watcher() i=6 2019-11-25T09:40:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:10.941+0000 7f34c8ec7ec0 20 remove_watcher() i=7 2019-11-25T09:40:11.018 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T09:40:11.140 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.070+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.170 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.101+0000 7fd3108c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:40:11.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.101+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.114+0000 7fd3108c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:40:11.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.114+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.197 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.127+0000 7fd3108c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:40:11.197 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.128+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.215 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.146+0000 7fd3108c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:40:11.418 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.349+0000 7fd3108c8ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T09:40:11.419 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.349+0000 7fd3108c8ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T09:40:11.419 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.349+0000 7fd3108c8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T09:40:11.419 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.349+0000 7fd3108c8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T09:40:11.419 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.349+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.429 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.360+0000 7fd3108c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:40:11.430 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.360+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.439 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.370+0000 7fd3108c8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:40:11.439 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.370+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.383+0000 7fd3108c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:40:11.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.383+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.465 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.395+0000 7fd3108c8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:40:11.465 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.395+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.472 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.403+0000 7fd3108c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:40:11.472 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.403+0000 7fd3108c8ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T09:40:11.472 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.403+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.478 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.408+0000 7fd3108c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:40:11.478 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.408+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.488 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.419+0000 7fd3108c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:40:11.489 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.419+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.430+0000 7fd3108c8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T09:40:11.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.430+0000 7fd3108c8ec0 20 zonegroup default 2019-11-25T09:40:11.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.430+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.511 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.442+0000 7fd3108c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:40:11.511 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.442+0000 7fd3108c8ec0 10 Cannot find current period zone using local zone 2019-11-25T09:40:11.512 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.442+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.515 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.446+0000 7fd3108c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T09:40:11.516 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.446+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.526 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.457+0000 7fd3108c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T09:40:11.526 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.457+0000 7fd3108c8ec0 20 rados->read ofs=0 len=0 2019-11-25T09:40:11.537 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.467+0000 7fd3108c8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T09:40:11.537 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.467+0000 7fd3108c8ec0 20 zone default found 2019-11-25T09:40:11.537 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.467+0000 7fd3108c8ec0 20 started sync module instance, tier type = 2019-11-25T09:40:11.537 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.467+0000 7fd3108c8ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T09:40:11.875 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.806+0000 7fd3108c8ec0 20 add_watcher() i=0 2019-11-25T09:40:11.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.806+0000 7fd3108c8ec0 20 add_watcher() i=1 2019-11-25T09:40:11.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.806+0000 7fd3108c8ec0 20 add_watcher() i=2 2019-11-25T09:40:11.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.806+0000 7fd3108c8ec0 20 add_watcher() i=3 2019-11-25T09:40:11.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.806+0000 7fd3108c8ec0 20 add_watcher() i=4 2019-11-25T09:40:11.877 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.806+0000 7fd3108c8ec0 20 add_watcher() i=5 2019-11-25T09:40:11.877 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.806+0000 7fd3108c8ec0 20 add_watcher() i=6 2019-11-25T09:40:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.834+0000 7fd3108c8ec0 20 add_watcher() i=7 2019-11-25T09:40:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.834+0000 7fd3108c8ec0 2 all 8 watchers are set, enabling cache 2019-11-25T09:40:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.834+0000 7fd2ce7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T09:40:11.908 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.838+0000 7fd2fe2f7700 0 -- 172.21.15.135:0/2881814258 >> v1:172.21.15.174:6789/0 conn(0x5555eaf12050 legacy=0x5555eaf113e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T09:40:11.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:11.874+0000 7fd2fdaf6700 0 -- 172.21.15.135:0/1263258928 >> [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] conn(0x5555eaf4a7d0 msgr2=0x5555eaf4cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T09:40:13.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:13.857+0000 7fd244ff9700 20 reqs_thread_entry: start 2019-11-25T09:40:13.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:13.857+0000 7fd23e7fc700 20 reqs_thread_entry: start 2019-11-25T09:40:13.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:13.857+0000 7fd3108c8ec0 20 init_complete bucket index max shards: 0 2019-11-25T09:40:13.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:13.858+0000 7fd23cff9700 20 reqs_thread_entry: start 2019-11-25T09:40:13.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:13.858+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T09:40:13.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:13.921+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.011 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:13.940+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:14.020 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:13.949+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.062 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:13.991+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T09:40:14.137 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.066+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.086+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:14.167 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.096+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.216 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.146+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T09:40:14.309 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.238+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.348 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.277+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:14.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.295+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.428 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.358+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T09:40:14.483 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.412+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.507 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.436+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:14.518 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.447+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.575 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.505+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T09:40:14.644 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.570+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.664 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.593+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:14.675 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.605+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.714 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.643+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T09:40:14.789 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.718+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.818 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.747+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:14.840 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.770+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:14.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.821+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T09:40:14.986 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.915+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.023 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.953+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:15.040 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:14.970+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.107 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.036+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T09:40:15.207 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.133+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.244 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.173+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:15.257 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.186+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.297 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.227+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T09:40:15.343 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.272+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.291+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:15.372 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.302+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.407 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.337+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T09:40:15.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.403+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.497 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.427+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:15.512 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.441+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.551 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.480+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T09:40:15.597 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.526+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.543+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.552+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.581+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T09:40:15.744 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.674+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.772 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.702+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:15.789 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.714+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.760+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T09:40:15.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.818+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.909 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.839+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:15.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.851+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:15.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.893+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T09:40:16.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.945+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.030 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.961+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:16.038 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:15.969+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.078 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.008+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T09:40:16.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.120+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.216 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.146+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:16.231 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.161+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.200+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T09:40:16.328 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.259+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.353 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.284+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:16.371 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.302+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.404 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.335+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T09:40:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.402+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.492 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.420+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:16.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.432+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.465+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T09:40:16.594 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.524+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.619 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.548+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:16.629 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.559+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.658 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.588+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T09:40:16.758 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.689+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.792 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.722+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.736+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.844 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.774+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T09:40:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.824+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.910 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.840+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.850+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:16.968 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.899+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T09:40:17.019 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.949+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.035 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.965+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:16.974+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.072 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.003+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T09:40:17.121 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.051+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.136 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.067+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:17.148 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.078+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.118+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T09:40:17.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.171+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.261 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.191+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:17.273 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.203+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.321 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.251+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T09:40:17.407 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.338+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.428 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.358+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:17.438 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.368+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.403+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T09:40:17.550 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.480+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.575 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.506+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:17.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.519+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.641 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.571+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T09:40:17.712 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.641+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.676+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:17.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.692+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.821 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.752+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T09:40:17.875 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.805+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.823+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:17.904 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.834+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:17.951 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.881+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T09:40:18.028 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.957+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:18.053 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.984+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:18.065 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:17.995+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:18.121 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.051+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T09:40:18.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.172+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:18.273 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.203+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:18.289 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.219+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.274+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T09:40:18.438 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.368+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:18.465 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.395+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:18.481 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.411+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:18.548 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.478+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T09:40:18.617 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.547+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:18.645 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.575+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:18.657 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.587+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:18.699 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.629+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T09:40:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.684+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:18.795 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.726+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T09:40:18.815 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.745+0000 7fd3108c8ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T09:40:18.924 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.854+0000 7fd3108c8ec0 20 remove_watcher() i=0 2019-11-25T09:40:18.924 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.854+0000 7fd3108c8ec0 2 removed watcher, disabling cache 2019-11-25T09:40:18.997 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.927+0000 7fd3108c8ec0 20 remove_watcher() i=1 2019-11-25T09:40:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:18.983+0000 7fd3108c8ec0 20 remove_watcher() i=2 2019-11-25T09:40:19.116 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:19.046+0000 7fd3108c8ec0 20 remove_watcher() i=3 2019-11-25T09:40:19.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:19.093+0000 7fd3108c8ec0 20 remove_watcher() i=4 2019-11-25T09:40:19.215 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:19.145+0000 7fd3108c8ec0 20 remove_watcher() i=5 2019-11-25T09:40:19.276 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:19.206+0000 7fd3108c8ec0 20 remove_watcher() i=6 2019-11-25T09:40:19.329 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T09:40:19.259+0000 7fd3108c8ec0 20 remove_watcher() i=7 2019-11-25T09:40:19.336 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2019-11-25T09:40:19.985 INFO:teuthology.orchestra.run.smithi135.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2019-11-25T09:40:22.884 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.pom 2019-11-25T09:40:23.084 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.jar 2019-11-25T09:40:24.286 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :clean UP-TO-DATE 2019-11-25T09:40:24.384 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-bom/1.11.549/aws-java-sdk-bom-1.11.549.pom 2019-11-25T09:40:24.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.549/aws-java-sdk-pom-1.11.549.pom 2019-11-25T09:40:24.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom 2019-11-25T09:40:24.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.pom 2019-11-25T09:40:24.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.pom 2019-11-25T09:40:24.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.pom 2019-11-25T09:40:24.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.pom 2019-11-25T09:40:24.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.pom 2019-11-25T09:40:24.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.pom 2019-11-25T09:40:24.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-parent/2.44.0/selenium-parent-2.44.0.pom 2019-11-25T09:40:24.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom 2019-11-25T09:40:24.786 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.pom 2019-11-25T09:40:24.786 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.pom 2019-11-25T09:40:24.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.pom 2019-11-25T09:40:24.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.pom 2019-11-25T09:40:24.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.pom 2019-11-25T09:40:24.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.pom 2019-11-25T09:40:24.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.5/httpcomponents-client-4.5.5.pom 2019-11-25T09:40:24.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.2/jackson-parent-2.6.2.pom 2019-11-25T09:40:24.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/28/commons-parent-28.pom 2019-11-25T09:40:24.788 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/24/oss-parent-24.pom 2019-11-25T09:40:24.788 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/10/httpcomponents-parent-10.pom 2019-11-25T09:40:24.788 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2019-11-25T09:40:24.789 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2019-11-25T09:40:24.885 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.pom 2019-11-25T09:40:24.885 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.pom 2019-11-25T09:40:24.885 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.pom 2019-11-25T09:40:24.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.pom 2019-11-25T09:40:24.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.pom 2019-11-25T09:40:24.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.pom 2019-11-25T09:40:24.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.pom 2019-11-25T09:40:24.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.pom 2019-11-25T09:40:24.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.pom 2019-11-25T09:40:24.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.pom 2019-11-25T09:40:24.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.pom 2019-11-25T09:40:24.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.pom 2019-11-25T09:40:24.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.pom 2019-11-25T09:40:24.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.pom 2019-11-25T09:40:24.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.pom 2019-11-25T09:40:24.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.pom 2019-11-25T09:40:24.889 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.pom 2019-11-25T09:40:24.889 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.pom 2019-11-25T09:40:24.889 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.pom 2019-11-25T09:40:24.889 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.pom 2019-11-25T09:40:24.889 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.pom 2019-11-25T09:40:24.889 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.pom 2019-11-25T09:40:24.889 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.pom 2019-11-25T09:40:24.889 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.pom 2019-11-25T09:40:24.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.pom 2019-11-25T09:40:24.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.pom 2019-11-25T09:40:24.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.pom 2019-11-25T09:40:24.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.pom 2019-11-25T09:40:24.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.pom 2019-11-25T09:40:24.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.pom 2019-11-25T09:40:24.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.pom 2019-11-25T09:40:24.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.pom 2019-11-25T09:40:24.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.pom 2019-11-25T09:40:24.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.pom 2019-11-25T09:40:24.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.pom 2019-11-25T09:40:24.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.pom 2019-11-25T09:40:24.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.pom 2019-11-25T09:40:24.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.pom 2019-11-25T09:40:24.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.pom 2019-11-25T09:40:24.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.pom 2019-11-25T09:40:24.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.pom 2019-11-25T09:40:24.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.pom 2019-11-25T09:40:24.989 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.pom 2019-11-25T09:40:24.989 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.pom 2019-11-25T09:40:24.989 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.pom 2019-11-25T09:40:24.989 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.pom 2019-11-25T09:40:24.989 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.pom 2019-11-25T09:40:24.989 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.pom 2019-11-25T09:40:24.989 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.pom 2019-11-25T09:40:24.990 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.pom 2019-11-25T09:40:24.990 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.pom 2019-11-25T09:40:24.990 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.pom 2019-11-25T09:40:24.990 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.pom 2019-11-25T09:40:24.990 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.pom 2019-11-25T09:40:24.990 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.pom 2019-11-25T09:40:24.990 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.pom 2019-11-25T09:40:24.991 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.pom 2019-11-25T09:40:24.991 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.pom 2019-11-25T09:40:25.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.pom 2019-11-25T09:40:25.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.pom 2019-11-25T09:40:25.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.pom 2019-11-25T09:40:25.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.pom 2019-11-25T09:40:25.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.pom 2019-11-25T09:40:25.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.pom 2019-11-25T09:40:25.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.pom 2019-11-25T09:40:25.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.pom 2019-11-25T09:40:25.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.pom 2019-11-25T09:40:25.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.pom 2019-11-25T09:40:25.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.pom 2019-11-25T09:40:25.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.pom 2019-11-25T09:40:25.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.pom 2019-11-25T09:40:25.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.pom 2019-11-25T09:40:25.089 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.pom 2019-11-25T09:40:25.089 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.pom 2019-11-25T09:40:25.089 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.pom 2019-11-25T09:40:25.089 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.pom 2019-11-25T09:40:25.089 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.pom 2019-11-25T09:40:25.089 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.pom 2019-11-25T09:40:25.089 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.pom 2019-11-25T09:40:25.090 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.pom 2019-11-25T09:40:25.090 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.pom 2019-11-25T09:40:25.090 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.pom 2019-11-25T09:40:25.090 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.pom 2019-11-25T09:40:25.090 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.pom 2019-11-25T09:40:25.090 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.pom 2019-11-25T09:40:25.090 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.pom 2019-11-25T09:40:25.091 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.pom 2019-11-25T09:40:25.091 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.pom 2019-11-25T09:40:25.091 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.pom 2019-11-25T09:40:25.091 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.pom 2019-11-25T09:40:25.091 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.pom 2019-11-25T09:40:25.091 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.pom 2019-11-25T09:40:25.091 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.pom 2019-11-25T09:40:25.092 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.pom 2019-11-25T09:40:25.092 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.pom 2019-11-25T09:40:25.092 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.pom 2019-11-25T09:40:25.092 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.pom 2019-11-25T09:40:25.092 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.pom 2019-11-25T09:40:25.092 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.pom 2019-11-25T09:40:25.092 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.pom 2019-11-25T09:40:25.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.pom 2019-11-25T09:40:25.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.pom 2019-11-25T09:40:25.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.pom 2019-11-25T09:40:25.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.pom 2019-11-25T09:40:25.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.pom 2019-11-25T09:40:25.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.pom 2019-11-25T09:40:25.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.pom 2019-11-25T09:40:25.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.pom 2019-11-25T09:40:25.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.pom 2019-11-25T09:40:25.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.pom 2019-11-25T09:40:25.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.pom 2019-11-25T09:40:25.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.pom 2019-11-25T09:40:25.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.pom 2019-11-25T09:40:25.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.pom 2019-11-25T09:40:25.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.pom 2019-11-25T09:40:25.189 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.pom 2019-11-25T09:40:25.189 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.pom 2019-11-25T09:40:25.189 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.pom 2019-11-25T09:40:25.189 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.pom 2019-11-25T09:40:25.189 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.pom 2019-11-25T09:40:25.189 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.pom 2019-11-25T09:40:25.189 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.pom 2019-11-25T09:40:25.190 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.pom 2019-11-25T09:40:25.190 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.pom 2019-11-25T09:40:25.190 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.pom 2019-11-25T09:40:25.190 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.pom 2019-11-25T09:40:25.190 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.pom 2019-11-25T09:40:25.190 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.pom 2019-11-25T09:40:25.190 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.pom 2019-11-25T09:40:25.191 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.pom 2019-11-25T09:40:25.191 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.pom 2019-11-25T09:40:25.191 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.pom 2019-11-25T09:40:25.191 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.pom 2019-11-25T09:40:25.191 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.pom 2019-11-25T09:40:25.191 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.pom 2019-11-25T09:40:25.191 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.pom 2019-11-25T09:40:25.192 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.pom 2019-11-25T09:40:25.192 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.pom 2019-11-25T09:40:25.192 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.pom 2019-11-25T09:40:25.192 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.pom 2019-11-25T09:40:25.192 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.pom 2019-11-25T09:40:25.192 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.pom 2019-11-25T09:40:25.192 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.pom 2019-11-25T09:40:25.285 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.pom 2019-11-25T09:40:25.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.pom 2019-11-25T09:40:25.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.pom 2019-11-25T09:40:25.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.pom 2019-11-25T09:40:25.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.pom 2019-11-25T09:40:25.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.pom 2019-11-25T09:40:25.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.pom 2019-11-25T09:40:25.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.pom 2019-11-25T09:40:25.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.pom 2019-11-25T09:40:25.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.pom 2019-11-25T09:40:25.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.pom 2019-11-25T09:40:25.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.pom 2019-11-25T09:40:25.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.pom 2019-11-25T09:40:25.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.pom 2019-11-25T09:40:25.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.pom 2019-11-25T09:40:25.288 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.pom 2019-11-25T09:40:25.288 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.pom 2019-11-25T09:40:25.288 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.pom 2019-11-25T09:40:25.288 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.pom 2019-11-25T09:40:25.288 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.pom 2019-11-25T09:40:25.288 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.pom 2019-11-25T09:40:25.288 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.pom 2019-11-25T09:40:25.289 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.22/aws-java-sdk-pom-1.11.22.pom 2019-11-25T09:40:25.289 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.pom 2019-11-25T09:40:25.289 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.pom 2019-11-25T09:40:25.289 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom 2019-11-25T09:40:25.289 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.pom 2019-11-25T09:40:25.289 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.pom 2019-11-25T09:40:25.289 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.pom 2019-11-25T09:40:25.290 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.pom 2019-11-25T09:40:25.290 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.pom 2019-11-25T09:40:25.290 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.pom 2019-11-25T09:40:25.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.9/commons-codec-1.9.pom 2019-11-25T09:40:25.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/project/6.1.9/project-6.1.9.pom 2019-11-25T09:40:25.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.pom 2019-11-25T09:40:25.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/32/commons-parent-32.pom 2019-11-25T09:40:25.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom 2019-11-25T09:40:25.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.pom 2019-11-25T09:40:25.386 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.pom 2019-11-25T09:40:25.386 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom 2019-11-25T09:40:25.386 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.pom 2019-11-25T09:40:25.386 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/34/commons-parent-34.pom 2019-11-25T09:40:25.484 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.pom 2019-11-25T09:40:25.485 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom 2019-11-25T09:40:25.485 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2019-11-25T09:40:25.485 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.pom 2019-11-25T09:40:25.485 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.9/httpcomponents-core-4.4.9.pom 2019-11-25T09:40:25.485 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/9/httpcomponents-parent-9.pom 2019-11-25T09:40:25.584 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom 2019-11-25T09:40:25.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.pom 2019-11-25T09:40:25.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.1/jackson-parent-2.6.1.pom 2019-11-25T09:40:25.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/23/oss-parent-23.pom 2019-11-25T09:40:25.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.pom 2019-11-25T09:40:25.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.pom 2019-11-25T09:40:25.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-parent/4.1.17.Final/netty-parent-4.1.17.Final.pom 2019-11-25T09:40:25.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2019-11-25T09:40:25.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.pom 2019-11-25T09:40:25.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.pom 2019-11-25T09:40:25.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.pom 2019-11-25T09:40:25.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.pom 2019-11-25T09:40:25.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.pom 2019-11-25T09:40:25.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.pom 2019-11-25T09:40:25.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.pom 2019-11-25T09:40:25.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/6/oss-parent-6.pom 2019-11-25T09:40:25.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.pom 2019-11-25T09:40:25.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.pom 2019-11-25T09:40:25.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.pom 2019-11-25T09:40:25.785 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.pom 2019-11-25T09:40:25.785 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.pom 2019-11-25T09:40:25.785 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.pom 2019-11-25T09:40:25.786 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.pom 2019-11-25T09:40:25.786 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/25/commons-parent-25.pom 2019-11-25T09:40:25.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/17/commons-parent-17.pom 2019-11-25T09:40:25.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/7/apache-7.pom 2019-11-25T09:40:25.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/9/apache-9.pom 2019-11-25T09:40:25.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.pom 2019-11-25T09:40:25.788 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.pom 2019-11-25T09:40:25.885 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.pom 2019-11-25T09:40:25.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2019-11-25T09:40:25.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.pom 2019-11-25T09:40:25.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.pom 2019-11-25T09:40:25.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.pom 2019-11-25T09:40:25.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.pom 2019-11-25T09:40:25.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.pom 2019-11-25T09:40:25.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.pom 2019-11-25T09:40:25.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/18.0/guava-parent-18.0.pom 2019-11-25T09:40:25.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.pom 2019-11-25T09:40:25.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.pom 2019-11-25T09:40:25.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.pom 2019-11-25T09:40:25.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.pom 2019-11-25T09:40:25.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.pom 2019-11-25T09:40:25.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.pom 2019-11-25T09:40:25.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.pom 2019-11-25T09:40:25.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.pom 2019-11-25T09:40:25.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.pom 2019-11-25T09:40:25.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/33/commons-parent-33.pom 2019-11-25T09:40:25.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/8.1.15.v20140411/jetty-project-8.1.15.v20140411.pom 2019-11-25T09:40:25.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/9/commons-parent-9.pom 2019-11-25T09:40:25.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/4/apache-4.pom 2019-11-25T09:40:25.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/20/jetty-parent-20.pom 2019-11-25T09:40:25.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom 2019-11-25T09:40:25.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/project/7/project-7.pom 2019-11-25T09:40:25.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.pom 2019-11-25T09:40:25.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.pom 2019-11-25T09:40:25.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.pom 2019-11-25T09:40:25.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.pom 2019-11-25T09:40:25.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.pom 2019-11-25T09:40:25.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.pom 2019-11-25T09:40:26.885 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.jar 2019-11-25T09:40:26.885 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.jar 2019-11-25T09:40:26.885 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.jar 2019-11-25T09:40:26.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.jar 2019-11-25T09:40:26.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.jar 2019-11-25T09:40:26.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.jar 2019-11-25T09:40:26.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.jar 2019-11-25T09:40:26.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.jar 2019-11-25T09:40:26.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.jar 2019-11-25T09:40:26.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.jar 2019-11-25T09:40:26.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.jar 2019-11-25T09:40:26.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.jar 2019-11-25T09:40:26.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.jar 2019-11-25T09:40:26.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.jar 2019-11-25T09:40:26.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.jar 2019-11-25T09:40:26.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.jar 2019-11-25T09:40:26.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.jar 2019-11-25T09:40:26.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.jar 2019-11-25T09:40:26.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.jar 2019-11-25T09:40:26.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.jar 2019-11-25T09:40:26.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.jar 2019-11-25T09:40:26.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.jar 2019-11-25T09:40:26.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.jar 2019-11-25T09:40:26.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.jar 2019-11-25T09:40:26.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.jar 2019-11-25T09:40:26.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.jar 2019-11-25T09:40:26.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.jar 2019-11-25T09:40:26.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.jar 2019-11-25T09:40:26.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.jar 2019-11-25T09:40:26.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.jar 2019-11-25T09:40:26.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.jar 2019-11-25T09:40:26.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.jar 2019-11-25T09:40:26.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.jar 2019-11-25T09:40:26.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.jar 2019-11-25T09:40:26.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.jar 2019-11-25T09:40:26.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.jar 2019-11-25T09:40:26.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.jar 2019-11-25T09:40:26.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.jar 2019-11-25T09:40:26.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.jar 2019-11-25T09:40:26.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.jar 2019-11-25T09:40:26.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.jar 2019-11-25T09:40:26.988 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.jar 2019-11-25T09:40:26.989 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.jar 2019-11-25T09:40:26.989 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.jar 2019-11-25T09:40:27.085 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.jar 2019-11-25T09:40:27.085 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.jar 2019-11-25T09:40:27.085 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.jar 2019-11-25T09:40:27.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.jar 2019-11-25T09:40:27.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.jar 2019-11-25T09:40:27.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.jar 2019-11-25T09:40:27.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.jar 2019-11-25T09:40:27.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.jar 2019-11-25T09:40:27.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.jar 2019-11-25T09:40:27.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.jar 2019-11-25T09:40:27.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.jar 2019-11-25T09:40:27.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.jar 2019-11-25T09:40:27.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.jar 2019-11-25T09:40:27.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.jar 2019-11-25T09:40:27.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.jar 2019-11-25T09:40:27.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.jar 2019-11-25T09:40:27.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.jar 2019-11-25T09:40:27.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.jar 2019-11-25T09:40:27.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.jar 2019-11-25T09:40:27.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.jar 2019-11-25T09:40:27.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.jar 2019-11-25T09:40:27.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.jar 2019-11-25T09:40:27.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.jar 2019-11-25T09:40:27.185 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.jar 2019-11-25T09:40:27.185 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.jar 2019-11-25T09:40:27.185 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.jar 2019-11-25T09:40:27.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.jar 2019-11-25T09:40:27.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.jar 2019-11-25T09:40:27.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.jar 2019-11-25T09:40:27.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.jar 2019-11-25T09:40:27.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.jar 2019-11-25T09:40:27.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.jar 2019-11-25T09:40:27.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.jar 2019-11-25T09:40:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.jar 2019-11-25T09:40:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.jar 2019-11-25T09:40:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.jar 2019-11-25T09:40:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.jar 2019-11-25T09:40:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.jar 2019-11-25T09:40:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.jar 2019-11-25T09:40:27.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.jar 2019-11-25T09:40:27.285 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.jar 2019-11-25T09:40:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.jar 2019-11-25T09:40:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.jar 2019-11-25T09:40:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.jar 2019-11-25T09:40:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.jar 2019-11-25T09:40:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.jar 2019-11-25T09:40:27.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.jar 2019-11-25T09:40:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar 2019-11-25T09:40:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.jar 2019-11-25T09:40:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.jar 2019-11-25T09:40:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.jar 2019-11-25T09:40:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.jar 2019-11-25T09:40:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.jar 2019-11-25T09:40:27.287 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.jar 2019-11-25T09:40:27.288 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.jar 2019-11-25T09:40:27.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.jar 2019-11-25T09:40:27.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.jar 2019-11-25T09:40:27.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.jar 2019-11-25T09:40:27.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.jar 2019-11-25T09:40:27.385 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.jar 2019-11-25T09:40:27.391 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.jar 2019-11-25T09:40:27.391 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.jar 2019-11-25T09:40:27.391 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.jar 2019-11-25T09:40:27.486 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.jar 2019-11-25T09:40:27.486 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.jar 2019-11-25T09:40:27.486 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.jar 2019-11-25T09:40:27.486 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.jar 2019-11-25T09:40:27.486 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.jar 2019-11-25T09:40:27.487 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.jar 2019-11-25T09:40:27.487 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.jar 2019-11-25T09:40:27.487 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.jar 2019-11-25T09:40:27.487 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.jar 2019-11-25T09:40:27.487 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.jar 2019-11-25T09:40:27.487 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.jar 2019-11-25T09:40:27.487 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.jar 2019-11-25T09:40:27.488 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.jar 2019-11-25T09:40:27.488 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.jar 2019-11-25T09:40:27.488 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.jar 2019-11-25T09:40:27.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.jar 2019-11-25T09:40:27.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.jar 2019-11-25T09:40:27.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.jar 2019-11-25T09:40:27.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.jar 2019-11-25T09:40:27.585 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.jar 2019-11-25T09:40:27.586 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.jar 2019-11-25T09:40:27.586 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.jar 2019-11-25T09:40:27.586 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.jar 2019-11-25T09:40:27.586 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.jar 2019-11-25T09:40:27.586 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.jar 2019-11-25T09:40:27.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.jar 2019-11-25T09:40:27.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.jar 2019-11-25T09:40:27.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.jar 2019-11-25T09:40:27.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.jar 2019-11-25T09:40:27.685 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.jar 2019-11-25T09:40:27.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.jar 2019-11-25T09:40:27.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.jar 2019-11-25T09:40:27.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.jar 2019-11-25T09:40:27.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.jar 2019-11-25T09:40:27.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.jar 2019-11-25T09:40:27.686 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.jar 2019-11-25T09:40:27.785 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.jar 2019-11-25T09:40:27.785 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.jar 2019-11-25T09:40:27.785 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.jar 2019-11-25T09:40:27.785 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.jar 2019-11-25T09:40:27.785 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.jar 2019-11-25T09:40:27.786 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.jar 2019-11-25T09:40:27.786 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.jar 2019-11-25T09:40:27.786 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.jar 2019-11-25T09:40:27.786 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.jar 2019-11-25T09:40:27.786 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.jar 2019-11-25T09:40:27.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.jar 2019-11-25T09:40:27.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.jar 2019-11-25T09:40:27.787 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.jar 2019-11-25T09:40:27.885 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.jar 2019-11-25T09:40:27.885 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.jar 2019-11-25T09:40:27.885 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.jar 2019-11-25T09:40:27.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.jar 2019-11-25T09:40:27.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.jar 2019-11-25T09:40:27.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.jar 2019-11-25T09:40:27.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.jar 2019-11-25T09:40:27.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.jar 2019-11-25T09:40:27.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.jar 2019-11-25T09:40:27.886 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.jar 2019-11-25T09:40:27.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.jar 2019-11-25T09:40:27.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar 2019-11-25T09:40:27.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.jar 2019-11-25T09:40:27.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.jar 2019-11-25T09:40:27.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.jar 2019-11-25T09:40:27.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.jar 2019-11-25T09:40:27.887 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.jar 2019-11-25T09:40:27.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.jar 2019-11-25T09:40:27.888 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.jar 2019-11-25T09:40:27.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.jar 2019-11-25T09:40:27.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.jar 2019-11-25T09:40:27.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.jar 2019-11-25T09:40:27.985 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.jar 2019-11-25T09:40:27.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.jar 2019-11-25T09:40:27.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.jar 2019-11-25T09:40:27.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar 2019-11-25T09:40:27.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar 2019-11-25T09:40:27.986 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.jar 2019-11-25T09:40:27.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.jar 2019-11-25T09:40:27.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.jar 2019-11-25T09:40:27.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar 2019-11-25T09:40:27.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.jar 2019-11-25T09:40:27.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.jar 2019-11-25T09:40:27.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.jar 2019-11-25T09:40:27.987 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.jar 2019-11-25T09:40:28.085 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.jar 2019-11-25T09:40:28.085 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.jar 2019-11-25T09:40:28.085 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.jar 2019-11-25T09:40:28.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar 2019-11-25T09:40:28.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar 2019-11-25T09:40:28.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.jar 2019-11-25T09:40:28.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar 2019-11-25T09:40:28.086 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.jar 2019-11-25T09:40:28.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.jar 2019-11-25T09:40:28.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar 2019-11-25T09:40:28.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.jar 2019-11-25T09:40:28.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar 2019-11-25T09:40:28.087 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.jar 2019-11-25T09:40:28.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar 2019-11-25T09:40:28.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar 2019-11-25T09:40:28.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar 2019-11-25T09:40:28.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar 2019-11-25T09:40:28.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar 2019-11-25T09:40:28.088 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar 2019-11-25T09:40:28.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar 2019-11-25T09:40:28.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar 2019-11-25T09:40:28.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar 2019-11-25T09:40:28.186 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar 2019-11-25T09:40:28.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.jar 2019-11-25T09:40:28.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar 2019-11-25T09:40:28.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar 2019-11-25T09:40:28.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar 2019-11-25T09:40:28.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.jar 2019-11-25T09:40:28.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.jar 2019-11-25T09:40:28.187 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.jar 2019-11-25T09:40:28.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.jar 2019-11-25T09:40:28.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar 2019-11-25T09:40:28.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar 2019-11-25T09:40:28.188 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.jar 2019-11-25T09:40:28.189 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.jar 2019-11-25T09:40:28.189 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.jar 2019-11-25T09:40:28.285 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.jar 2019-11-25T09:40:28.285 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.jar 2019-11-25T09:40:28.285 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar 2019-11-25T09:40:28.285 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.jar 2019-11-25T09:40:28.285 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.jar 2019-11-25T09:40:28.285 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.jar 2019-11-25T09:40:28.285 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.jar 2019-11-25T09:40:28.286 INFO:teuthology.orchestra.run.smithi135.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.jar 2019-11-25T09:40:37.385 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :compileJava 2019-11-25T09:40:37.386 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :processResources 2019-11-25T09:40:37.386 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :classes 2019-11-25T09:40:37.886 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:40:37.886 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :compileTestJava 2019-11-25T09:40:37.886 INFO:teuthology.orchestra.run.smithi135.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-25T09:40:37.886 INFO:teuthology.orchestra.run.smithi135.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-25T09:40:37.887 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:40:37.887 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :processTestResources NO-SOURCE 2019-11-25T09:40:37.887 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :testClasses 2019-11-25T09:40:45.686 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:40:45.686 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :test 2019-11-25T09:40:45.686 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:40:45.686 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2019-11-25T09:41:20.812 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:16:34.003 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:41:20.816 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:16:34.007 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:41:20.853 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:16:34.043 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:41:20.854 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:16:34.045 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:41:20.894 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:16:34.158 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:41:20.896 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:16:34.162 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:41:21.024 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:16:34.215 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:41:21.061 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:16:34.251 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:41:21.120 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:16:34.385 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:41:27.989 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:41:27.989 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2019-11-25T09:41:32.389 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:41:32.390 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2019-11-25T09:41:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:41:35.390 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2019-11-25T09:41:42.790 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:41:42.791 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2019-11-25T09:42:02.291 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:42:02.292 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2019-11-25T09:42:10.692 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:42:10.692 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2019-11-25T09:42:10.892 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:42:10.892 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2019-11-25T09:42:12.092 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:42:12.093 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2019-11-25T09:42:14.890 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:17:28.077 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:42:14.898 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:17:28.085 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:42:14.904 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:17:28.091 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:42:14.918 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:17:28.184 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:42:14.921 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:17:28.108 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:42:14.928 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:17:28.194 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:42:14.938 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:17:28.126 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:42:14.968 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:17:28.155 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:42:14.969 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:17:28.235 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:42:15.092 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:42:15.092 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2019-11-25T09:42:19.593 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:42:19.593 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2019-11-25T09:42:45.694 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:42:45.695 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2019-11-25T09:43:04.096 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:43:04.096 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2019-11-25T09:46:32.708 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:21:45.876 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:46:32.743 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:21:45.911 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:46:32.750 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:21:45.918 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:46:32.773 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:21:46.042 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:46:32.779 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:21:45.947 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:46:32.791 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:21:46.061 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:46:32.923 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:21:46.091 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:46:32.984 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:21:46.253 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:46:32.984 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:21:46.152 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:47:11.714 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:47:11.715 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2019-11-25T09:47:24.715 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:47:24.715 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2019-11-25T09:47:27.022 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:47:27.023 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2019-11-25T09:47:34.015 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:47:34.016 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2019-11-25T09:47:37.515 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:47:37.516 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2019-11-25T09:47:46.916 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:47:46.916 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2019-11-25T09:48:08.116 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:48:08.116 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2019-11-25T09:48:14.816 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:48:14.816 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2019-11-25T09:48:15.116 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:48:15.116 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2019-11-25T09:48:16.317 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:48:16.317 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2019-11-25T09:48:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:48:35.724 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2019-11-25T09:48:43.417 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:48:43.417 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2019-11-25T09:49:10.117 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:49:10.117 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2019-11-25T09:49:26.317 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:49:26.318 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2019-11-25T09:49:57.118 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:49:57.118 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2019-11-25T09:50:06.019 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:50:06.019 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2019-11-25T09:50:36.314 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:25:49.475 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:50:36.338 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:25:49.498 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:50:36.393 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:25:49.660 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:50:36.400 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:25:49.666 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:50:36.468 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:25:49.629 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:50:36.517 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:25:49.678 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:50:36.519 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:25:49.680 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:50:36.525 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:25:49.791 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:50:36.666 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:25:49.827 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:56:57.424 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:32:10.577 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:56:57.440 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:32:10.585 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:56:57.440 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:32:10.588 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:56:57.440 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:32:10.594 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:56:57.450 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:32:10.705 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:56:57.461 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:32:10.716 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:56:57.653 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:32:10.806 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T09:56:57.657 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:32:10.810 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T09:56:57.702 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:32:10.957 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T09:57:22.126 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:57:22.126 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2019-11-25T09:57:29.926 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:57:29.927 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2019-11-25T09:58:10.427 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:58:10.428 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2019-11-25T09:58:18.127 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:58:18.127 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2019-11-25T09:58:50.728 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:58:50.728 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2019-11-25T09:58:58.328 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:58:58.328 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2019-11-25T09:59:07.528 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:59:07.528 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2019-11-25T09:59:24.028 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:59:24.029 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2019-11-25T09:59:26.129 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:59:26.129 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2019-11-25T09:59:31.928 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:59:31.929 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2019-11-25T09:59:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:59:36.129 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2019-11-25T09:59:42.829 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:59:42.829 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2019-11-25T09:59:47.529 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:59:47.529 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2019-11-25T09:59:56.429 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:59:56.429 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2019-11-25T09:59:59.529 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T09:59:59.529 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2019-11-25T10:00:07.429 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:00:07.429 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2019-11-25T10:00:10.129 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:00:10.129 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2019-11-25T10:00:17.529 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:00:17.529 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2019-11-25T10:00:21.729 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:00:21.730 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2019-11-25T10:00:27.630 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:00:27.630 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2019-11-25T10:00:30.530 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:00:30.530 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2019-11-25T10:00:39.230 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:00:39.230 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2019-11-25T10:01:14.230 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:01:14.231 INFO:teuthology.orchestra.run.smithi135.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2019-11-25T10:01:22.531 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:01:22.531 INFO:teuthology.orchestra.run.smithi135.stdout:---------------------------------------------------------------------- 2019-11-25T10:01:22.531 INFO:teuthology.orchestra.run.smithi135.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2019-11-25T10:01:22.531 INFO:teuthology.orchestra.run.smithi135.stdout:---------------------------------------------------------------------- 2019-11-25T10:01:22.708 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:01:22.708 INFO:teuthology.orchestra.run.smithi135.stdout:BUILD SUCCESSFUL in 21m 3s 2019-11-25T10:01:22.709 INFO:teuthology.orchestra.run.smithi135.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2019-11-25T10:01:23.027 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T10:01:23.253 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.210+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.278 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.235+0000 7fb392437ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:23.278 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.235+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.242+0000 7fb392437ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:23.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.242+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.290 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.247+0000 7fb392437ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:23.290 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.247+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.306 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.264+0000 7fb392437ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:23.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.456+0000 7fb392437ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:01:23.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.456+0000 7fb392437ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:01:23.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.456+0000 7fb392437ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:01:23.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.456+0000 7fb392437ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:01:23.500 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.456+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.512 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.470+0000 7fb392437ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:23.512 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.470+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.529 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.487+0000 7fb392437ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:01:23.529 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.487+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.544 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.502+0000 7fb392437ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:23.544 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.502+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.554 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.511+0000 7fb392437ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:01:23.554 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.511+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.521+0000 7fb392437ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:23.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.521+0000 7fb392437ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:01:23.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.521+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.570 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.528+0000 7fb392437ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:23.570 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.528+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.585 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.542+0000 7fb392437ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:23.585 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.542+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.553+0000 7fb392437ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:01:23.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.553+0000 7fb392437ec0 20 zonegroup default 2019-11-25T10:01:23.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.553+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.605 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.562+0000 7fb392437ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:23.605 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.562+0000 7fb392437ec0 10 Cannot find current period zone using local zone 2019-11-25T10:01:23.605 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.562+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.611 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.569+0000 7fb392437ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:23.611 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.569+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.628 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.586+0000 7fb392437ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:23.628 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.586+0000 7fb392437ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:23.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.596+0000 7fb392437ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:01:23.639 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.596+0000 7fb392437ec0 20 zone default found 2019-11-25T10:01:23.639 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.596+0000 7fb392437ec0 20 started sync module instance, tier type = 2019-11-25T10:01:23.639 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:23.596+0000 7fb392437ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:01:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.048+0000 7fb392437ec0 20 add_watcher() i=0 2019-11-25T10:01:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.048+0000 7fb392437ec0 20 add_watcher() i=1 2019-11-25T10:01:24.091 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.048+0000 7fb392437ec0 20 add_watcher() i=2 2019-11-25T10:01:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.048+0000 7fb392437ec0 20 add_watcher() i=3 2019-11-25T10:01:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.048+0000 7fb392437ec0 20 add_watcher() i=4 2019-11-25T10:01:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.048+0000 7fb392437ec0 20 add_watcher() i=5 2019-11-25T10:01:24.092 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.048+0000 7fb392437ec0 20 add_watcher() i=6 2019-11-25T10:01:24.124 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.081+0000 7fb392437ec0 20 add_watcher() i=7 2019-11-25T10:01:24.124 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.081+0000 7fb392437ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:01:24.125 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.081+0000 7fb34ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:01:24.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.084+0000 7fb37ee64700 0 -- 172.21.15.135:0/457090004 >> v2:172.21.15.174:3300/0 conn(0x55cab6198c30 msgr2=0x55cab6199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-25T10:01:24.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:24.128+0000 7fb37ee64700 0 -- 172.21.15.135:0/404791659 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x7fb2c0002840 msgr2=0x7fb2c0002d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:01:25.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:25.903+0000 7fb2be7fc700 20 reqs_thread_entry: start 2019-11-25T10:01:25.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:25.903+0000 7fb2b7fff700 20 reqs_thread_entry: start 2019-11-25T10:01:25.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:25.903+0000 7fb392437ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:01:25.946 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:25.904+0000 7fb2b67fc700 20 reqs_thread_entry: start 2019-11-25T10:01:25.946 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:25.904+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T10:01:26.043 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.001+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:26.079 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.038+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:26.092 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.050+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:26.138 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.096+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T10:01:26.196 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.154+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:26.218 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.176+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.386', time=2019-11-25T11:42:04.335346+0000, chain.objs.size()=9 2019-11-25T10:01:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.15__multipart_key1.2~TXoyWkx1Y6uiBdw7dhSGtcqfWSXUk2D.1 2019-11-25T10:01:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.15__shadow_key1.2~TXoyWkx1Y6uiBdw7dhSGtcqfWSXUk2D.1_1 2019-11-25T10:01:26.244 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.15__multipart_key1.2~TXoyWkx1Y6uiBdw7dhSGtcqfWSXUk2D.2 2019-11-25T10:01:26.244 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.15__shadow_key1.2~TXoyWkx1Y6uiBdw7dhSGtcqfWSXUk2D.2_1 2019-11-25T10:01:26.244 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.15__multipart_key1.2~TXoyWkx1Y6uiBdw7dhSGtcqfWSXUk2D.3 2019-11-25T10:01:26.244 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.15__shadow_key1.2~TXoyWkx1Y6uiBdw7dhSGtcqfWSXUk2D.3_1 2019-11-25T10:01:26.244 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.15__multipart_key1.2~TXoyWkx1Y6uiBdw7dhSGtcqfWSXUk2D.4 2019-11-25T10:01:26.245 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.15__shadow_key1.2~TXoyWkx1Y6uiBdw7dhSGtcqfWSXUk2D.4_1 2019-11-25T10:01:26.245 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.201+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.15__multipart_key1.2~TXoyWkx1Y6uiBdw7dhSGtcqfWSXUk2D.5 2019-11-25T10:01:26.648 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.607+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.692+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T10:01:26.773 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.731+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:26.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.749+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:26.798 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.757+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:26.836 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.795+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T10:01:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.849+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:26.912 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.871+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:26.926 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.884+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:26.976 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.935+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T10:01:27.032 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:26.990+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:27.060 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.018+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:27.068 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.027+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:27.106 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.065+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T10:01:27.159 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.118+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:27.179 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.137+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:27.212 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:01:27.212 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.528', time=2019-11-25T11:48:38.209682+0000, chain.objs.size()=9 2019-11-25T10:01:27.212 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.25__multipart_key1.2~AhMJTigFQAxWrAEjGTIbJSmZijeZ6UC.1 2019-11-25T10:01:27.212 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.25__shadow_key1.2~AhMJTigFQAxWrAEjGTIbJSmZijeZ6UC.1_1 2019-11-25T10:01:27.212 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.25__multipart_key1.2~AhMJTigFQAxWrAEjGTIbJSmZijeZ6UC.2 2019-11-25T10:01:27.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.25__shadow_key1.2~AhMJTigFQAxWrAEjGTIbJSmZijeZ6UC.2_1 2019-11-25T10:01:27.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.25__multipart_key1.2~AhMJTigFQAxWrAEjGTIbJSmZijeZ6UC.3 2019-11-25T10:01:27.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.25__shadow_key1.2~AhMJTigFQAxWrAEjGTIbJSmZijeZ6UC.3_1 2019-11-25T10:01:27.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.25__multipart_key1.2~AhMJTigFQAxWrAEjGTIbJSmZijeZ6UC.4 2019-11-25T10:01:27.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.25__shadow_key1.2~AhMJTigFQAxWrAEjGTIbJSmZijeZ6UC.4_1 2019-11-25T10:01:27.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.25__multipart_key1.2~AhMJTigFQAxWrAEjGTIbJSmZijeZ6UC.5 2019-11-25T10:01:27.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.636', time=2019-11-25T11:57:20.800171+0000, chain.objs.size()=16 2019-11-25T10:01:27.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.1 2019-11-25T10:01:27.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.1_1 2019-11-25T10:01:27.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.169+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.1_2 2019-11-25T10:01:27.572 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.530+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.2 2019-11-25T10:01:27.674 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.632+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.2_1 2019-11-25T10:01:27.674 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.632+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.2_2 2019-11-25T10:01:27.675 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.632+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.3 2019-11-25T10:01:27.675 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.632+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.3_1 2019-11-25T10:01:27.675 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.632+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.3_2 2019-11-25T10:01:27.715 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.671+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.4 2019-11-25T10:01:27.715 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.671+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.4_1 2019-11-25T10:01:27.715 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.671+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.4_2 2019-11-25T10:01:27.834 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.793+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.5 2019-11-25T10:01:27.835 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.793+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.5_1 2019-11-25T10:01:27.948 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.906+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.5_2 2019-11-25T10:01:27.953 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:27.911+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~EZ5PZW0ol5WMuBiyGgz3_ZNXXt1ORrb.6 2019-11-25T10:01:28.372 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.330+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:28.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.412+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T10:01:28.512 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.471+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:28.530 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.489+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:28.542 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.500+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:28.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.541+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T10:01:28.670 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.628+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:28.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.658+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:28.719 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.677+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:28.747 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.706+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T10:01:28.786 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.744+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:28.803 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.762+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:28.821 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~5YCHi9tfay6iANGO7eprl5bnbi1TZLb', time=2019-11-25T11:41:26.722350+0000, chain.objs.size()=9 2019-11-25T10:01:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.13__multipart_key1.2~5YCHi9tfay6iANGO7eprl5bnbi1TZLb.1 2019-11-25T10:01:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.13__shadow_key1.2~5YCHi9tfay6iANGO7eprl5bnbi1TZLb.1_1 2019-11-25T10:01:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.13__multipart_key1.2~5YCHi9tfay6iANGO7eprl5bnbi1TZLb.2 2019-11-25T10:01:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.13__shadow_key1.2~5YCHi9tfay6iANGO7eprl5bnbi1TZLb.2_1 2019-11-25T10:01:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.13__multipart_key1.2~5YCHi9tfay6iANGO7eprl5bnbi1TZLb.3 2019-11-25T10:01:28.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.13__shadow_key1.2~5YCHi9tfay6iANGO7eprl5bnbi1TZLb.3_1 2019-11-25T10:01:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.13__multipart_key1.2~5YCHi9tfay6iANGO7eprl5bnbi1TZLb.4 2019-11-25T10:01:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.13__shadow_key1.2~5YCHi9tfay6iANGO7eprl5bnbi1TZLb.4_1 2019-11-25T10:01:28.823 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:28.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.13__multipart_key1.2~5YCHi9tfay6iANGO7eprl5bnbi1TZLb.5 2019-11-25T10:01:29.377 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.335+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:29.490 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.448+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T10:01:29.548 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.506+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.529+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.620', time=2019-11-25T11:55:22.686953+0000, chain.objs.size()=19 2019-11-25T10:01:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.1 2019-11-25T10:01:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.1_1 2019-11-25T10:01:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.2 2019-11-25T10:01:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.2_1 2019-11-25T10:01:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.3 2019-11-25T10:01:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.3_1 2019-11-25T10:01:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.4 2019-11-25T10:01:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.4_1 2019-11-25T10:01:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.5 2019-11-25T10:01:29.590 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.5_1 2019-11-25T10:01:29.590 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.6 2019-11-25T10:01:29.590 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.546+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.6_1 2019-11-25T10:01:29.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.849+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.7 2019-11-25T10:01:29.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.878+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.7_1 2019-11-25T10:01:29.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.878+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.8 2019-11-25T10:01:29.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:29.901+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.8_1 2019-11-25T10:01:30.083 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.041+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.9 2019-11-25T10:01:30.083 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.041+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.9_1 2019-11-25T10:01:30.083 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.041+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~VgJY6RqHG2XETPYtaDSVf4CbsLl_Hzx.10 2019-11-25T10:01:30.416 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.374+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:30.488 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.446+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T10:01:30.524 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.482+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:30.538 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.496+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:30.548 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.506+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.506+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~QMeXxvWNt3fhv6N0YoU3ViOB3O_uu8o', time=2019-11-25T11:50:01.780182+0000, chain.objs.size()=5 2019-11-25T10:01:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.506+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.27__multipart_key1.2~QMeXxvWNt3fhv6N0YoU3ViOB3O_uu8o.7 2019-11-25T10:01:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.506+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.27__shadow_key1.2~QMeXxvWNt3fhv6N0YoU3ViOB3O_uu8o.7_1 2019-11-25T10:01:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.506+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.27__multipart_key1.2~QMeXxvWNt3fhv6N0YoU3ViOB3O_uu8o.10 2019-11-25T10:01:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.506+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.27__shadow_key1.2~QMeXxvWNt3fhv6N0YoU3ViOB3O_uu8o.10_1 2019-11-25T10:01:30.549 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.506+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.27__multipart_key1.2~QMeXxvWNt3fhv6N0YoU3ViOB3O_uu8o.13 2019-11-25T10:01:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.680+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:30.829 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.787+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T10:01:30.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.844+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:30.906 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.864+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:01:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.595', time=2019-11-25T11:52:53.524560+0000, chain.objs.size()=21 2019-11-25T10:01:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.1 2019-11-25T10:01:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.1_1 2019-11-25T10:01:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.2 2019-11-25T10:01:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.2_1 2019-11-25T10:01:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.3 2019-11-25T10:01:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.3_1 2019-11-25T10:01:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.4 2019-11-25T10:01:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.4_1 2019-11-25T10:01:30.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.5 2019-11-25T10:01:30.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.5_1 2019-11-25T10:01:30.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.6 2019-11-25T10:01:30.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:30.900+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.6_1 2019-11-25T10:01:31.215 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.173+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.7 2019-11-25T10:01:31.347 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.305+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.7_1 2019-11-25T10:01:31.347 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.305+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.8 2019-11-25T10:01:31.347 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.305+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.8_1 2019-11-25T10:01:31.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.318+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.9 2019-11-25T10:01:31.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.318+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.9_1 2019-11-25T10:01:31.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.318+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.10 2019-11-25T10:01:31.361 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.318+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.10_1 2019-11-25T10:01:31.361 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.318+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~MpaCCotGezMtS-k7TdLpVkVMh3d_GnW.11 2019-11-25T10:01:31.361 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.318+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.644', time=2019-11-25T11:57:25.057911+0000, chain.objs.size()=16 2019-11-25T10:01:31.361 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.318+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.1 2019-11-25T10:01:31.361 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.318+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.1_1 2019-11-25T10:01:31.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.571+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.1_2 2019-11-25T10:01:31.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.658+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.2 2019-11-25T10:01:31.892 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.850+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.2_1 2019-11-25T10:01:31.892 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.850+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.2_2 2019-11-25T10:01:31.892 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.850+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.3 2019-11-25T10:01:31.892 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.850+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.3_1 2019-11-25T10:01:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.850+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.3_2 2019-11-25T10:01:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.850+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.4 2019-11-25T10:01:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.850+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.4_1 2019-11-25T10:01:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.850+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.4_2 2019-11-25T10:01:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.850+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.5 2019-11-25T10:01:31.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.850+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.5_1 2019-11-25T10:01:32.038 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:31.996+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.5_2 2019-11-25T10:01:32.124 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.082+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~JnKD1VGErnjMtDLBuYMcD_YP3w6oWHw.6 2019-11-25T10:01:32.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.813+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:32.962 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.920+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T10:01:33.006 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.964+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:33.021 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.979+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:33.034 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:33.034 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.438', time=2019-11-25T11:45:04.728913+0000, chain.objs.size()=9 2019-11-25T10:01:33.034 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~1TwCJope5eDg_jDOWvzMT_2vVOI2GGo.1 2019-11-25T10:01:33.034 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~1TwCJope5eDg_jDOWvzMT_2vVOI2GGo.1_1 2019-11-25T10:01:33.035 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~1TwCJope5eDg_jDOWvzMT_2vVOI2GGo.2 2019-11-25T10:01:33.035 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~1TwCJope5eDg_jDOWvzMT_2vVOI2GGo.2_1 2019-11-25T10:01:33.035 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~1TwCJope5eDg_jDOWvzMT_2vVOI2GGo.3 2019-11-25T10:01:33.035 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~1TwCJope5eDg_jDOWvzMT_2vVOI2GGo.3_1 2019-11-25T10:01:33.035 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~1TwCJope5eDg_jDOWvzMT_2vVOI2GGo.4 2019-11-25T10:01:33.035 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~1TwCJope5eDg_jDOWvzMT_2vVOI2GGo.4_1 2019-11-25T10:01:33.036 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:32.992+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~1TwCJope5eDg_jDOWvzMT_2vVOI2GGo.5 2019-11-25T10:01:33.349 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.307+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:33.680 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.638+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T10:01:33.768 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.726+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:33.804 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.762+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:33.818 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.776+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:33.885 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.843+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T10:01:33.960 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.918+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:33.991 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.949+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:34.011 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:34.011 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.509', time=2019-11-25T11:48:08.828876+0000, chain.objs.size()=9 2019-11-25T10:01:34.011 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.24__multipart_key1.2~yyTPkoA3yeULzuTEmZkYC4CEuwAlfHE.1 2019-11-25T10:01:34.011 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.24__shadow_key1.2~yyTPkoA3yeULzuTEmZkYC4CEuwAlfHE.1_1 2019-11-25T10:01:34.012 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.24__multipart_key1.2~yyTPkoA3yeULzuTEmZkYC4CEuwAlfHE.2 2019-11-25T10:01:34.012 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.24__shadow_key1.2~yyTPkoA3yeULzuTEmZkYC4CEuwAlfHE.2_1 2019-11-25T10:01:34.012 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.24__multipart_key1.2~yyTPkoA3yeULzuTEmZkYC4CEuwAlfHE.3 2019-11-25T10:01:34.012 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.24__shadow_key1.2~yyTPkoA3yeULzuTEmZkYC4CEuwAlfHE.3_1 2019-11-25T10:01:34.013 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.24__multipart_key1.2~yyTPkoA3yeULzuTEmZkYC4CEuwAlfHE.4 2019-11-25T10:01:34.013 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.24__shadow_key1.2~yyTPkoA3yeULzuTEmZkYC4CEuwAlfHE.4_1 2019-11-25T10:01:34.013 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:33.968+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.24__multipart_key1.2~yyTPkoA3yeULzuTEmZkYC4CEuwAlfHE.5 2019-11-25T10:01:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.350+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:34.797 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.754+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T10:01:34.863 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.821+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:34.883 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.841+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:34.918 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:34.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD', time=2019-11-25T11:59:18.152751+0000, chain.objs.size()=46 2019-11-25T10:01:34.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.1 2019-11-25T10:01:34.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.2 2019-11-25T10:01:34.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.3 2019-11-25T10:01:34.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.4 2019-11-25T10:01:34.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.5 2019-11-25T10:01:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.6 2019-11-25T10:01:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.7 2019-11-25T10:01:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.8 2019-11-25T10:01:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.9 2019-11-25T10:01:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.10 2019-11-25T10:01:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.11 2019-11-25T10:01:34.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:34.876+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.12 2019-11-25T10:01:35.135 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.094+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.13 2019-11-25T10:01:35.267 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.225+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.14 2019-11-25T10:01:35.267 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.225+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.15 2019-11-25T10:01:35.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.361+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.16 2019-11-25T10:01:35.404 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.361+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.17 2019-11-25T10:01:35.404 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.361+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.18 2019-11-25T10:01:35.404 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.361+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.5WCLmK8uoqeNfIV2ijCGRQCDBYu6bC5.19 2019-11-25T10:01:35.404 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.361+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.g3gW6MeeuNzdVkDD1xxBBmpb-h686Pv.20 2019-11-25T10:01:35.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.413+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.21 2019-11-25T10:01:35.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.413+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.22 2019-11-25T10:01:35.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.413+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.23 2019-11-25T10:01:35.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.413+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.24 2019-11-25T10:01:35.726 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.684+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.25 2019-11-25T10:01:35.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:35.811+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.26 2019-11-25T10:01:36.103 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.061+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.27 2019-11-25T10:01:36.103 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.061+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.28 2019-11-25T10:01:36.104 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.061+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.29 2019-11-25T10:01:36.104 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.061+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.30 2019-11-25T10:01:36.104 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.061+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.31 2019-11-25T10:01:36.104 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.061+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.32 2019-11-25T10:01:36.104 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.061+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.33 2019-11-25T10:01:36.104 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.061+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.34 2019-11-25T10:01:36.105 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.061+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.35 2019-11-25T10:01:36.197 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.155+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.36 2019-11-25T10:01:36.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.354+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.37 2019-11-25T10:01:36.475 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.433+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.38 2019-11-25T10:01:36.475 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.433+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.39 2019-11-25T10:01:36.475 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.433+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.40 2019-11-25T10:01:36.475 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.433+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.41 2019-11-25T10:01:36.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.433+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.42 2019-11-25T10:01:36.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.433+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.43 2019-11-25T10:01:36.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.433+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.44 2019-11-25T10:01:36.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.433+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.45 2019-11-25T10:01:36.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.433+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.31__multipart_key1.2~-HuXBEeYMJwmn7sycyWgSnGQttf-tkD.47 2019-11-25T10:01:36.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:36.903+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:37.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.003+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T10:01:37.092 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.050+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:37.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.066+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:37.118 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.077+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:37.152 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.109+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T10:01:37.209 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.167+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:37.224 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.182+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:37.235 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.191+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:37.276 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.234+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T10:01:37.364 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.322+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:37.391 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.349+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:37.412 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.369+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:37.413 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.369+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.446', time=2019-11-25T11:45:38.331145+0000, chain.objs.size()=9 2019-11-25T10:01:37.413 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.370+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~QP5CB6xHp94jrsgM3O9VrNybdguRvPN.1 2019-11-25T10:01:37.413 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.370+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~QP5CB6xHp94jrsgM3O9VrNybdguRvPN.1_1 2019-11-25T10:01:37.413 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.370+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~QP5CB6xHp94jrsgM3O9VrNybdguRvPN.2 2019-11-25T10:01:37.414 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.370+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~QP5CB6xHp94jrsgM3O9VrNybdguRvPN.2_1 2019-11-25T10:01:37.414 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.370+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~QP5CB6xHp94jrsgM3O9VrNybdguRvPN.3 2019-11-25T10:01:37.414 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.370+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~QP5CB6xHp94jrsgM3O9VrNybdguRvPN.3_1 2019-11-25T10:01:37.414 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.370+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~QP5CB6xHp94jrsgM3O9VrNybdguRvPN.4 2019-11-25T10:01:37.414 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.370+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~QP5CB6xHp94jrsgM3O9VrNybdguRvPN.4_1 2019-11-25T10:01:37.415 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.370+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~QP5CB6xHp94jrsgM3O9VrNybdguRvPN.5 2019-11-25T10:01:37.778 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.736+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:37.902 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.860+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T10:01:37.940 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.897+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:37.954 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.912+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:37.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:37.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.674', time=2019-11-25T11:58:52.394291+0000, chain.objs.size()=9 2019-11-25T10:01:37.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.30__multipart_key1.2~iseB4hVQRFT4icKGXDdIdUZSMIAnprJ.1 2019-11-25T10:01:37.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.30__shadow_key1.2~iseB4hVQRFT4icKGXDdIdUZSMIAnprJ.1_1 2019-11-25T10:01:37.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.30__multipart_key1.2~iseB4hVQRFT4icKGXDdIdUZSMIAnprJ.2 2019-11-25T10:01:37.968 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.30__shadow_key1.2~iseB4hVQRFT4icKGXDdIdUZSMIAnprJ.2_1 2019-11-25T10:01:37.968 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.30__multipart_key1.2~iseB4hVQRFT4icKGXDdIdUZSMIAnprJ.3 2019-11-25T10:01:37.968 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.30__shadow_key1.2~iseB4hVQRFT4icKGXDdIdUZSMIAnprJ.3_1 2019-11-25T10:01:37.968 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.30__multipart_key1.2~iseB4hVQRFT4icKGXDdIdUZSMIAnprJ.4 2019-11-25T10:01:37.968 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.30__shadow_key1.2~iseB4hVQRFT4icKGXDdIdUZSMIAnprJ.4_1 2019-11-25T10:01:37.968 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:37.924+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.30__multipart_key1.2~iseB4hVQRFT4icKGXDdIdUZSMIAnprJ.5 2019-11-25T10:01:38.423 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.381+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:38.504 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.463+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T10:01:38.546 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.504+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:38.562 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.520+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:01:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.466', time=2019-11-25T11:47:10.480240+0000, chain.objs.size()=7 2019-11-25T10:01:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~ccbpp1RHEscqTedNrAC-GrzOxlK98rU.1 2019-11-25T10:01:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~ccbpp1RHEscqTedNrAC-GrzOxlK98rU.1_1 2019-11-25T10:01:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~ccbpp1RHEscqTedNrAC-GrzOxlK98rU.1_2 2019-11-25T10:01:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~ccbpp1RHEscqTedNrAC-GrzOxlK98rU.2 2019-11-25T10:01:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~ccbpp1RHEscqTedNrAC-GrzOxlK98rU.2_1 2019-11-25T10:01:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~ccbpp1RHEscqTedNrAC-GrzOxlK98rU.2_2 2019-11-25T10:01:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~ccbpp1RHEscqTedNrAC-GrzOxlK98rU.3 2019-11-25T10:01:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.841', time=2019-11-25T12:01:16.265620+0000, chain.objs.size()=21 2019-11-25T10:01:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.1 2019-11-25T10:01:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__shadow_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.1_1 2019-11-25T10:01:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.2 2019-11-25T10:01:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__shadow_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.2_1 2019-11-25T10:01:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.3 2019-11-25T10:01:38.857 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.815+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__shadow_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.3_1 2019-11-25T10:01:38.857 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.815+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.4 2019-11-25T10:01:38.949 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.907+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__shadow_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.4_1 2019-11-25T10:01:39.020 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.978+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.5 2019-11-25T10:01:39.020 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:38.978+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__shadow_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.5_1 2019-11-25T10:01:39.124 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.082+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.6 2019-11-25T10:01:39.125 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.082+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__shadow_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.6_1 2019-11-25T10:01:39.125 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.082+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.7 2019-11-25T10:01:39.125 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.082+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__shadow_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.7_1 2019-11-25T10:01:39.125 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.082+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.8 2019-11-25T10:01:39.125 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.082+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__shadow_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.8_1 2019-11-25T10:01:39.250 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.208+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.9 2019-11-25T10:01:39.692 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.650+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__shadow_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.9_1 2019-11-25T10:01:39.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.768+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.10 2019-11-25T10:01:39.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.768+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__shadow_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.10_1 2019-11-25T10:01:39.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:39.768+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.39__multipart_key1.2~_vrDM_tH7GegdJPb1zlP55lRozmgti-.11 2019-11-25T10:01:40.104 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.062+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:40.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.148+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T10:01:40.253 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.211+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:40.270 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.228+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:40.279 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.237+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:40.312 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.270+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T10:01:40.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.347+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:40.420 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.378+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:40.446 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.404+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:40.446 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.404+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.430', time=2019-11-25T11:47:20.275431+0000, chain.objs.size()=5 2019-11-25T10:01:40.446 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.404+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.19__shadow_.fomOGyTklJOZpF2MZf385rO48AsthB7_1 2019-11-25T10:01:40.447 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.404+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.19__shadow_.fomOGyTklJOZpF2MZf385rO48AsthB7_2 2019-11-25T10:01:40.447 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.404+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.19__shadow_.fomOGyTklJOZpF2MZf385rO48AsthB7_3 2019-11-25T10:01:40.447 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.404+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.19__shadow_.fomOGyTklJOZpF2MZf385rO48AsthB7_4 2019-11-25T10:01:40.447 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.404+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.19__shadow_.fomOGyTklJOZpF2MZf385rO48AsthB7_5 2019-11-25T10:01:40.701 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.658+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:40.816 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.773+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T10:01:40.859 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.816+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:40.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.831+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:40.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:40.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.659', time=2019-11-25T11:58:12.614241+0000, chain.objs.size()=9 2019-11-25T10:01:40.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.29__multipart_key1.2~JCelXdhuwkwgoCiY1ktshwtv8rU2eR4.1 2019-11-25T10:01:40.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.29__shadow_key1.2~JCelXdhuwkwgoCiY1ktshwtv8rU2eR4.1_1 2019-11-25T10:01:40.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.29__multipart_key1.2~JCelXdhuwkwgoCiY1ktshwtv8rU2eR4.2 2019-11-25T10:01:40.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.29__shadow_key1.2~JCelXdhuwkwgoCiY1ktshwtv8rU2eR4.2_1 2019-11-25T10:01:40.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.29__multipart_key1.2~JCelXdhuwkwgoCiY1ktshwtv8rU2eR4.3 2019-11-25T10:01:40.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.29__shadow_key1.2~JCelXdhuwkwgoCiY1ktshwtv8rU2eR4.3_1 2019-11-25T10:01:40.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.29__multipart_key1.2~JCelXdhuwkwgoCiY1ktshwtv8rU2eR4.4 2019-11-25T10:01:40.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.29__shadow_key1.2~JCelXdhuwkwgoCiY1ktshwtv8rU2eR4.4_1 2019-11-25T10:01:40.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:40.844+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.29__multipart_key1.2~JCelXdhuwkwgoCiY1ktshwtv8rU2eR4.5 2019-11-25T10:01:41.297 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.254+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:41.376 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.333+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T10:01:41.414 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.371+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:41.432 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.389+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:41.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.408+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:01:41.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.408+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.454', time=2019-11-25T11:46:08.326800+0000, chain.objs.size()=9 2019-11-25T10:01:41.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.408+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~9CsdE-3BECNhJCX2l_hvIZUezy2-Bhl.1 2019-11-25T10:01:41.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.408+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~9CsdE-3BECNhJCX2l_hvIZUezy2-Bhl.1_1 2019-11-25T10:01:41.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.408+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~9CsdE-3BECNhJCX2l_hvIZUezy2-Bhl.2 2019-11-25T10:01:41.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.408+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~9CsdE-3BECNhJCX2l_hvIZUezy2-Bhl.2_1 2019-11-25T10:01:41.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.409+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~9CsdE-3BECNhJCX2l_hvIZUezy2-Bhl.3 2019-11-25T10:01:41.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.409+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~9CsdE-3BECNhJCX2l_hvIZUezy2-Bhl.3_1 2019-11-25T10:01:41.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.409+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~9CsdE-3BECNhJCX2l_hvIZUezy2-Bhl.4 2019-11-25T10:01:41.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.409+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~9CsdE-3BECNhJCX2l_hvIZUezy2-Bhl.4_1 2019-11-25T10:01:41.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.409+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~9CsdE-3BECNhJCX2l_hvIZUezy2-Bhl.5 2019-11-25T10:01:41.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.409+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.560', time=2019-11-25T11:49:12.361160+0000, chain.objs.size()=9 2019-11-25T10:01:41.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.409+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__multipart_file.mpg.2~SCCoIMirrWxJLBcwAiyBkMnsCInHRyC.1 2019-11-25T10:01:41.454 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.409+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__shadow_file.mpg.2~SCCoIMirrWxJLBcwAiyBkMnsCInHRyC.1_1 2019-11-25T10:01:41.454 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.409+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__multipart_file.mpg.2~SCCoIMirrWxJLBcwAiyBkMnsCInHRyC.2 2019-11-25T10:01:41.851 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.808+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__shadow_file.mpg.2~SCCoIMirrWxJLBcwAiyBkMnsCInHRyC.2_1 2019-11-25T10:01:41.852 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.808+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__multipart_file.mpg.2~SCCoIMirrWxJLBcwAiyBkMnsCInHRyC.3 2019-11-25T10:01:41.852 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.808+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__shadow_file.mpg.2~SCCoIMirrWxJLBcwAiyBkMnsCInHRyC.3_1 2019-11-25T10:01:41.852 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.808+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__multipart_file.mpg.2~SCCoIMirrWxJLBcwAiyBkMnsCInHRyC.4 2019-11-25T10:01:41.852 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.808+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__shadow_file.mpg.2~SCCoIMirrWxJLBcwAiyBkMnsCInHRyC.4_1 2019-11-25T10:01:41.852 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:41.808+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__multipart_file.mpg.2~SCCoIMirrWxJLBcwAiyBkMnsCInHRyC.5 2019-11-25T10:01:42.309 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.266+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:42.425 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.379+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T10:01:42.463 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.420+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:42.478 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.435+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:42.486 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.443+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:42.517 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.474+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T10:01:42.552 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.509+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:42.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.524+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:42.582 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.538+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:01:42.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.538+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.415', time=2019-11-25T11:42:48.429958+0000, chain.objs.size()=9 2019-11-25T10:01:42.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.538+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__multipart_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.1 2019-11-25T10:01:42.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.538+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__shadow_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.1_1 2019-11-25T10:01:42.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.538+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__multipart_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.2 2019-11-25T10:01:42.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__shadow_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.2_1 2019-11-25T10:01:42.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__multipart_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.3 2019-11-25T10:01:42.584 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__shadow_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.3_1 2019-11-25T10:01:42.584 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__multipart_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.4 2019-11-25T10:01:42.584 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__shadow_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.4_1 2019-11-25T10:01:42.584 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__multipart_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.5 2019-11-25T10:01:42.584 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.539+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.417', time=2019-11-25T11:42:56.723919+0000, chain.objs.size()=9 2019-11-25T10:01:42.584 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__multipart_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.1 2019-11-25T10:01:42.584 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__shadow_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.1_1 2019-11-25T10:01:42.585 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.539+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__multipart_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.2 2019-11-25T10:01:42.691 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.648+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__shadow_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.2_1 2019-11-25T10:01:42.759 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.716+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__multipart_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.3 2019-11-25T10:01:42.803 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.759+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__shadow_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.3_1 2019-11-25T10:01:42.917 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.874+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__multipart_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.4 2019-11-25T10:01:42.918 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.874+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__shadow_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.4_1 2019-11-25T10:01:42.918 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:42.874+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.17__multipart_key1.2~023htv8KR-3W2T0D4xS1IEYjbSI_qWW.5 2019-11-25T10:01:43.355 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.312+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:43.481 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.438+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T10:01:43.536 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.493+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:43.556 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.513+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:43.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.523+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:43.618 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.575+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T10:01:43.665 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.622+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:43.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.638+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:43.689 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.646+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:43.730 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.687+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T10:01:43.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.740+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:43.803 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.761+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:43.830 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.786+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:01:43.830 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.786+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.559', time=2019-11-25T11:49:16.316019+0000, chain.objs.size()=9 2019-11-25T10:01:43.830 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.786+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__multipart_file2.mpg.2~fjeXj7cifKzWOJEkPN53dqxvFK9n39w.1 2019-11-25T10:01:43.830 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.786+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__shadow_file2.mpg.2~fjeXj7cifKzWOJEkPN53dqxvFK9n39w.1_1 2019-11-25T10:01:43.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.786+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__multipart_file2.mpg.2~fjeXj7cifKzWOJEkPN53dqxvFK9n39w.2 2019-11-25T10:01:43.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.786+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__shadow_file2.mpg.2~fjeXj7cifKzWOJEkPN53dqxvFK9n39w.2_1 2019-11-25T10:01:43.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.786+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__multipart_file2.mpg.2~fjeXj7cifKzWOJEkPN53dqxvFK9n39w.3 2019-11-25T10:01:43.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.786+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__shadow_file2.mpg.2~fjeXj7cifKzWOJEkPN53dqxvFK9n39w.3_1 2019-11-25T10:01:43.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.786+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__multipart_file2.mpg.2~fjeXj7cifKzWOJEkPN53dqxvFK9n39w.4 2019-11-25T10:01:43.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.787+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__shadow_file2.mpg.2~fjeXj7cifKzWOJEkPN53dqxvFK9n39w.4_1 2019-11-25T10:01:43.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.787+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.26__multipart_file2.mpg.2~fjeXj7cifKzWOJEkPN53dqxvFK9n39w.5 2019-11-25T10:01:43.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.787+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.608', time=2019-11-25T11:54:06.032818+0000, chain.objs.size()=21 2019-11-25T10:01:43.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.787+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.1 2019-11-25T10:01:43.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.787+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.1_1 2019-11-25T10:01:43.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:43.787+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.2 2019-11-25T10:01:44.069 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.025+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.2_1 2019-11-25T10:01:44.100 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.053+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.3 2019-11-25T10:01:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.223+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.3_1 2019-11-25T10:01:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.223+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.4 2019-11-25T10:01:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.223+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.4_1 2019-11-25T10:01:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.223+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.5 2019-11-25T10:01:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.223+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.5_1 2019-11-25T10:01:44.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.316+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.6 2019-11-25T10:01:44.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.316+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.6_1 2019-11-25T10:01:44.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.316+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.7 2019-11-25T10:01:44.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.316+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.7_1 2019-11-25T10:01:44.443 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.400+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.8 2019-11-25T10:01:44.533 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.490+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.8_1 2019-11-25T10:01:44.823 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.9 2019-11-25T10:01:44.823 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.9_1 2019-11-25T10:01:44.823 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.780+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.10 2019-11-25T10:01:44.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:44.831+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.10_1 2019-11-25T10:01:45.196 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:45.153+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~YCfhkgS03xyjni-ETN2optwsUtGwDwz.11 2019-11-25T10:01:45.682 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:45.639+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.081+0000 7fb34ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:01:46.208 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.165+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T10:01:46.277 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.234+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:46.308 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.265+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:46.333 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.289+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:01:46.334 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.289+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.460', time=2019-11-25T11:46:48.739105+0000, chain.objs.size()=7 2019-11-25T10:01:46.334 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.289+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~6hMifa7CC_dr-GrPK6CL8pRNEEkW_F1.1 2019-11-25T10:01:46.334 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.289+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~6hMifa7CC_dr-GrPK6CL8pRNEEkW_F1.1_1 2019-11-25T10:01:46.334 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.289+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~6hMifa7CC_dr-GrPK6CL8pRNEEkW_F1.1_2 2019-11-25T10:01:46.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.289+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~6hMifa7CC_dr-GrPK6CL8pRNEEkW_F1.2 2019-11-25T10:01:46.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.289+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~6hMifa7CC_dr-GrPK6CL8pRNEEkW_F1.2_1 2019-11-25T10:01:46.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.289+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~6hMifa7CC_dr-GrPK6CL8pRNEEkW_F1.2_2 2019-11-25T10:01:46.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.289+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~6hMifa7CC_dr-GrPK6CL8pRNEEkW_F1.3 2019-11-25T10:01:46.693 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.650+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:46.777 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.734+0000 7fb392437ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T10:01:46.827 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.784+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:46.850 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.807+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:46.870 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:01:46.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.472', time=2019-11-25T11:47:14.200348+0000, chain.objs.size()=7 2019-11-25T10:01:46.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~aa8AsXwybc1NUd9NtaR7brjwevKgHdz.1 2019-11-25T10:01:46.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~aa8AsXwybc1NUd9NtaR7brjwevKgHdz.1_1 2019-11-25T10:01:46.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~aa8AsXwybc1NUd9NtaR7brjwevKgHdz.1_2 2019-11-25T10:01:46.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~aa8AsXwybc1NUd9NtaR7brjwevKgHdz.2 2019-11-25T10:01:46.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~aa8AsXwybc1NUd9NtaR7brjwevKgHdz.2_1 2019-11-25T10:01:46.872 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__shadow_key1.2~aa8AsXwybc1NUd9NtaR7brjwevKgHdz.2_2 2019-11-25T10:01:46.872 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.20__multipart_key1.2~aa8AsXwybc1NUd9NtaR7brjwevKgHdz.3 2019-11-25T10:01:46.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.628', time=2019-11-25T11:56:26.652014+0000, chain.objs.size()=16 2019-11-25T10:01:46.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.1 2019-11-25T10:01:46.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.1_1 2019-11-25T10:01:46.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.1_2 2019-11-25T10:01:46.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.2 2019-11-25T10:01:46.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:46.827+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.2_1 2019-11-25T10:01:47.062 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.019+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.2_2 2019-11-25T10:01:47.226 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.183+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.3 2019-11-25T10:01:47.363 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.317+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.3_1 2019-11-25T10:01:47.363 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.317+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.3_2 2019-11-25T10:01:47.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.365+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.4 2019-11-25T10:01:47.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.365+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.4_1 2019-11-25T10:01:47.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.365+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.4_2 2019-11-25T10:01:47.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.365+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.5 2019-11-25T10:01:47.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.365+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.5_1 2019-11-25T10:01:47.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.365+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__shadow_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.5_2 2019-11-25T10:01:47.410 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:47.365+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.28__multipart_key1.2~QSrQJND4WrJP6WiwLmdW48fp5693b4a.6 2019-11-25T10:01:48.288 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.244+0000 7fb392437ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:01:48.426 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.383+0000 7fb392437ec0 20 remove_watcher() i=0 2019-11-25T10:01:48.427 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.383+0000 7fb392437ec0 2 removed watcher, disabling cache 2019-11-25T10:01:48.478 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.435+0000 7fb392437ec0 20 remove_watcher() i=1 2019-11-25T10:01:48.504 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.461+0000 7fb392437ec0 20 remove_watcher() i=2 2019-11-25T10:01:48.548 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.505+0000 7fb392437ec0 20 remove_watcher() i=3 2019-11-25T10:01:48.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.538+0000 7fb392437ec0 20 remove_watcher() i=4 2019-11-25T10:01:48.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.580+0000 7fb392437ec0 20 remove_watcher() i=5 2019-11-25T10:01:48.680 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.635+0000 7fb392437ec0 20 remove_watcher() i=6 2019-11-25T10:01:48.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.682+0000 7fb392437ec0 20 remove_watcher() i=7 2019-11-25T10:01:48.735 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T10:01:48.851 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.808+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:48.879 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.836+0000 7f9264f67ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:48.880 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.836+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.845+0000 7f9264f67ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.845+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:48.898 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.855+0000 7f9264f67ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:48.898 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.855+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:48.924 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:48.881+0000 7f9264f67ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:49.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.119+0000 7f9264f67ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:01:49.164 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.119+0000 7f9264f67ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:01:49.164 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.119+0000 7f9264f67ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:01:49.164 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.119+0000 7f9264f67ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:01:49.164 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.119+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.139+0000 7f9264f67ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:49.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.139+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.202 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.158+0000 7f9264f67ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:01:49.202 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.158+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.221 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.178+0000 7f9264f67ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:49.221 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.178+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.235 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.192+0000 7f9264f67ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:01:49.236 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.192+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.249 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.206+0000 7f9264f67ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:49.249 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.206+0000 7f9264f67ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:01:49.249 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.206+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.258 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.215+0000 7f9264f67ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:49.258 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.215+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.232+0000 7f9264f67ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:49.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.232+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.293 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.250+0000 7f9264f67ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:01:49.293 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.250+0000 7f9264f67ec0 20 zonegroup default 2019-11-25T10:01:49.293 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.250+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.260+0000 7f9264f67ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.260+0000 7f9264f67ec0 10 Cannot find current period zone using local zone 2019-11-25T10:01:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.260+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.269+0000 7f9264f67ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.269+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.326 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.282+0000 7f9264f67ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:49.326 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.283+0000 7f9264f67ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:49.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.295+0000 7f9264f67ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:01:49.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.295+0000 7f9264f67ec0 20 zone default found 2019-11-25T10:01:49.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.295+0000 7f9264f67ec0 20 started sync module instance, tier type = 2019-11-25T10:01:49.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.295+0000 7f9264f67ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:01:49.745 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.701+0000 7f9264f67ec0 20 add_watcher() i=0 2019-11-25T10:01:49.745 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.701+0000 7f9264f67ec0 20 add_watcher() i=1 2019-11-25T10:01:49.745 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.701+0000 7f9264f67ec0 20 add_watcher() i=2 2019-11-25T10:01:49.745 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.701+0000 7f9264f67ec0 20 add_watcher() i=3 2019-11-25T10:01:49.745 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.701+0000 7f9264f67ec0 20 add_watcher() i=4 2019-11-25T10:01:49.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.701+0000 7f9264f67ec0 20 add_watcher() i=5 2019-11-25T10:01:49.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.701+0000 7f9264f67ec0 20 add_watcher() i=6 2019-11-25T10:01:49.781 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.737+0000 7f9264f67ec0 20 add_watcher() i=7 2019-11-25T10:01:49.781 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.737+0000 7f9264f67ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:01:49.781 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.738+0000 7f9222fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:01:49.792 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.749+0000 7f9252996700 0 -- 172.21.15.135:0/1424753652 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x559e1b4d26c0 msgr2=0x559e1b5014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:01:49.825 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:49.782+0000 7f9252996700 0 -- 172.21.15.135:0/3676399722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559e1b4cc1f0 msgr2=0x559e1b4c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-25T10:01:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.521+0000 7f91917fa700 20 reqs_thread_entry: start 2019-11-25T10:01:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.522+0000 7f918affd700 20 reqs_thread_entry: start 2019-11-25T10:01:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.522+0000 7f9264f67ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:01:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.522+0000 7f91897fa700 20 reqs_thread_entry: start 2019-11-25T10:01:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.522+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T10:01:51.624 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.582+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:51.645 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.603+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:51.658 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.615+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:51.692 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.649+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T10:01:51.747 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.704+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.721+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:51.772 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.730+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:51.804 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.762+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T10:01:51.866 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.824+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:51.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.851+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:51.906 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.864+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:51.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.899+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T10:01:51.990 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.948+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.009 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.967+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:52.019 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:51.977+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.057 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.015+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T10:01:52.102 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.060+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.122 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.080+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:52.133 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.091+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.164 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.122+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T10:01:52.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.171+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.236 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.193+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:52.249 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.207+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.242+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T10:01:52.324 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.282+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.342 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.300+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:52.352 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.310+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.386 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.344+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T10:01:52.479 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.437+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.460+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:52.516 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.474+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.558 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.516+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T10:01:52.621 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.578+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.648 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.606+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:52.663 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.621+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.709 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.667+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T10:01:52.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.741+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.813 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.771+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:52.825 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.783+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:52.884 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.842+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T10:01:52.970 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.927+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.006 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.963+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:53.019 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:52.977+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.077 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.035+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T10:01:53.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.100+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.170 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.128+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:53.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.148+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.236 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.194+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T10:01:53.333 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.290+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.350 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.308+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:53.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.318+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.408 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.365+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T10:01:53.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.416+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.479 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.437+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:53.487 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.445+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.530 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.488+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T10:01:53.580 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.538+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.611 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.569+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:53.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.580+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.662 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.619+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T10:01:53.726 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.684+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.743 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.700+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:53.771 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.729+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.814 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.772+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T10:01:53.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.813+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.884 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.842+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:53.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.851+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:53.933 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.891+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T10:01:53.983 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.941+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.002 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.960+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:54.011 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:53.969+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.062 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.019+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T10:01:54.126 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.084+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.152 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.110+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:54.166 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.124+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.161+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T10:01:54.247 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.205+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.268 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.226+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:54.278 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.236+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.312 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.269+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T10:01:54.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.323+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.342+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:54.394 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.352+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.397+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T10:01:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.456+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.519 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.476+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:54.529 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.487+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.563 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.521+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T10:01:54.625 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.583+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.647 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.605+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:54.654 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.612+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.709 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.666+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T10:01:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.737+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.800 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.758+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:54.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.767+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.867 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.824+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T10:01:54.939 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.897+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:54.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.930+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:54.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:54.950+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.054 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.012+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T10:01:55.123 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.081+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.114+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.126+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.216 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.173+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T10:01:55.279 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.237+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.312 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.270+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:55.323 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.281+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.378 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.335+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T10:01:55.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.413+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.487 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.445+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:55.503 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.461+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.561 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.519+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T10:01:55.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.581+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.642 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.600+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:55.671 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.628+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.680+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T10:01:55.772 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.730+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.793 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.750+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:55.803 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.761+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.851 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.808+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T10:01:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.894+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.952+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:55.974+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:56.077 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.034+0000 7f9264f67ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T10:01:56.147 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.105+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:56.172 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.130+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:56.185 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.143+0000 7f9264f67ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:56.263 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.220+0000 7f9264f67ec0 20 remove_watcher() i=0 2019-11-25T10:01:56.263 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.220+0000 7f9264f67ec0 2 removed watcher, disabling cache 2019-11-25T10:01:56.329 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.287+0000 7f9264f67ec0 20 remove_watcher() i=1 2019-11-25T10:01:56.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.346+0000 7f9264f67ec0 20 remove_watcher() i=2 2019-11-25T10:01:56.450 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.407+0000 7f9264f67ec0 20 remove_watcher() i=3 2019-11-25T10:01:56.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.460+0000 7f9264f67ec0 20 remove_watcher() i=4 2019-11-25T10:01:56.558 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.516+0000 7f9264f67ec0 20 remove_watcher() i=5 2019-11-25T10:01:56.619 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.576+0000 7f9264f67ec0 20 remove_watcher() i=6 2019-11-25T10:01:56.688 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.645+0000 7f9264f67ec0 20 remove_watcher() i=7 2019-11-25T10:01:56.697 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T10:01:56.824 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.781+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:56.857 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.815+0000 7f6ebfd99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:56.857 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.815+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:56.869 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.826+0000 7f6ebfd99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:56.869 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.826+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:56.878 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.836+0000 7f6ebfd99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:56.878 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.836+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:56.857+0000 7f6ebfd99ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:57.144 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.102+0000 7f6ebfd99ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:01:57.145 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.102+0000 7f6ebfd99ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:01:57.145 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.102+0000 7f6ebfd99ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:01:57.145 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.102+0000 7f6ebfd99ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:01:57.145 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.102+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.159 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.116+0000 7f6ebfd99ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:57.159 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.116+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.172 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.130+0000 7f6ebfd99ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:01:57.172 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.130+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.141+0000 7f6ebfd99ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:57.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.141+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.150+0000 7f6ebfd99ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:01:57.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.150+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.200 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.158+0000 7f6ebfd99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:57.201 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.158+0000 7f6ebfd99ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:01:57.201 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.158+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.206 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.163+0000 7f6ebfd99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:57.206 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.163+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.217 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.175+0000 7f6ebfd99ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:57.218 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.175+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.226 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.183+0000 7f6ebfd99ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:01:57.226 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.183+0000 7f6ebfd99ec0 20 zonegroup default 2019-11-25T10:01:57.226 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.183+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.234 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.192+0000 7f6ebfd99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:57.234 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.192+0000 7f6ebfd99ec0 10 Cannot find current period zone using local zone 2019-11-25T10:01:57.235 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.192+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.199+0000 7f6ebfd99ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:01:57.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.199+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.250 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.208+0000 7f6ebfd99ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:01:57.250 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.208+0000 7f6ebfd99ec0 20 rados->read ofs=0 len=0 2019-11-25T10:01:57.258 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.216+0000 7f6ebfd99ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:01:57.258 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.216+0000 7f6ebfd99ec0 20 zone default found 2019-11-25T10:01:57.258 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.216+0000 7f6ebfd99ec0 20 started sync module instance, tier type = 2019-11-25T10:01:57.258 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.216+0000 7f6ebfd99ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:01:57.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.562+0000 7f6ebfd99ec0 20 add_watcher() i=0 2019-11-25T10:01:57.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.562+0000 7f6ebfd99ec0 20 add_watcher() i=1 2019-11-25T10:01:57.605 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.562+0000 7f6ebfd99ec0 20 add_watcher() i=2 2019-11-25T10:01:57.605 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.562+0000 7f6ebfd99ec0 20 add_watcher() i=3 2019-11-25T10:01:57.605 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.562+0000 7f6ebfd99ec0 20 add_watcher() i=4 2019-11-25T10:01:57.605 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.562+0000 7f6ebfd99ec0 20 add_watcher() i=5 2019-11-25T10:01:57.605 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.563+0000 7f6ebfd99ec0 20 add_watcher() i=6 2019-11-25T10:01:57.631 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.589+0000 7f6ebfd99ec0 20 add_watcher() i=7 2019-11-25T10:01:57.631 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.589+0000 7f6ebfd99ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:01:57.631 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.589+0000 7f6e7d7e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:01:57.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.595+0000 7f6eacfc7700 0 -- 172.21.15.135:0/3074851639 >> v2:172.21.15.174:3300/0 conn(0x562b45798580 msgr2=0x562b45798990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T10:01:57.840 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.798+0000 7f6eacfc7700 0 --2- 172.21.15.135:0/3074851639 >> v2:172.21.15.174:3300/0 conn(0x562b45798580 0x562b45798990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-25T10:01:57.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:57.844+0000 7f6eac7c6700 0 -- 172.21.15.135:0/207825247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b4579f210 msgr2=0x562b457a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:01:59.510 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.467+0000 7f6def7fe700 20 reqs_thread_entry: start 2019-11-25T10:01:59.510 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.468+0000 7f6ded7fa700 20 reqs_thread_entry: start 2019-11-25T10:01:59.510 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.468+0000 7f6ebfd99ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:01:59.511 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.468+0000 7f6ddb7fe700 20 reqs_thread_entry: start 2019-11-25T10:01:59.511 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.468+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T10:01:59.570 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.528+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:59.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.547+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:59.598 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.555+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:59.640 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.597+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T10:01:59.689 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.647+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:59.706 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.664+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:59.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.673+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:59.754 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.712+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T10:01:59.830 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.788+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:59.858 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.815+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:59.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.829+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:59.913 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.871+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T10:01:59.959 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.917+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:01:59.977 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.935+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:01:59.986 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.944+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.021 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:01:59.979+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T10:02:00.079 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.037+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.098 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.056+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:00.106 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.063+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.152 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.110+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T10:02:00.204 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.162+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.226 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.183+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:00.235 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.193+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.226+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T10:02:00.348 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.306+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.382 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.339+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:00.405 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.363+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.470 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.428+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T10:02:00.552 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.509+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.537+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:00.592 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.550+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.596+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T10:02:00.693 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.651+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.711 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.669+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:00.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.680+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.784 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.742+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T10:02:00.847 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.805+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.865 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.822+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:00.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.831+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.876+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T10:02:00.966 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.923+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:00.991 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.949+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:01.000 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.958+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:00.997+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T10:02:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.071+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.135 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.093+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:01.152 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.110+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.193 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.151+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T10:02:01.265 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.223+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.257+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:01.309 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.266+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.349 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.307+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T10:02:01.406 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.364+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.435 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.393+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:01.448 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.406+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.487 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.445+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T10:02:01.531 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.489+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.552 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.510+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:01.561 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.519+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.594 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.552+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T10:02:01.647 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.605+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.669 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.627+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:01.684 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.639+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.683+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T10:02:01.773 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.731+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.789 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.746+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:01.797 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.755+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.810+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T10:02:01.947 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.904+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.937+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:01.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:01.957+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.048 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.006+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T10:02:02.107 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.065+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.084+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:02.135 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.093+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.196 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.154+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T10:02:02.257 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.215+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.281 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.239+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:02.293 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.251+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.303+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T10:02:02.402 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.359+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.424 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.382+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:02.438 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.396+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.431+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T10:02:02.531 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.488+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.507+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:02.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.516+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.591 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.549+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T10:02:02.641 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.597+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.666 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.624+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:02.674 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.631+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.716 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.674+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T10:02:02.795 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.753+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.828 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.785+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:02.844 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.801+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:02.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.861+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T10:02:02.981 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.938+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.011 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.968+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:03.021 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:02.979+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.063 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.020+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T10:02:03.132 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.090+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.155 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.112+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:03.166 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.123+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.199 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.156+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T10:02:03.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.232+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.260+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:03.317 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.275+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.353 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.311+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T10:02:03.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.359+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.377+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:03.431 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.388+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.465 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.422+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T10:02:03.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.460+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.519 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.477+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:03.528 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.485+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.557 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.515+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T10:02:03.603 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.560+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.620 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.578+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:03.629 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.587+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.665 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.622+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T10:02:03.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.658+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.737 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.694+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:03.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.704+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.737+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T10:02:03.848 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.806+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.890 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.848+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:03.905 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.863+0000 7f6ebfd99ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:03.983 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.941+0000 7f6ebfd99ec0 20 remove_watcher() i=0 2019-11-25T10:02:03.984 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.941+0000 7f6ebfd99ec0 2 removed watcher, disabling cache 2019-11-25T10:02:04.025 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:03.983+0000 7f6ebfd99ec0 20 remove_watcher() i=1 2019-11-25T10:02:04.071 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.029+0000 7f6ebfd99ec0 20 remove_watcher() i=2 2019-11-25T10:02:04.135 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.092+0000 7f6ebfd99ec0 20 remove_watcher() i=3 2019-11-25T10:02:04.194 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.151+0000 7f6ebfd99ec0 20 remove_watcher() i=4 2019-11-25T10:02:04.252 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.210+0000 7f6ebfd99ec0 20 remove_watcher() i=5 2019-11-25T10:02:04.320 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.278+0000 7f6ebfd99ec0 20 remove_watcher() i=6 2019-11-25T10:02:04.367 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.324+0000 7f6ebfd99ec0 20 remove_watcher() i=7 2019-11-25T10:02:04.376 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T10:02:04.489 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.447+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.519 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.477+0000 7f75ffc37ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:02:04.519 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.477+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.528 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.486+0000 7f75ffc37ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:02:04.528 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.486+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.539 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.497+0000 7f75ffc37ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:02:04.539 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.497+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.567 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.525+0000 7f75ffc37ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:02:04.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.790+0000 7f75ffc37ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:02:04.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.790+0000 7f75ffc37ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:02:04.834 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.790+0000 7f75ffc37ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:02:04.834 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.790+0000 7f75ffc37ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:02:04.834 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.790+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.844 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.801+0000 7f75ffc37ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:02:04.844 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.801+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.859 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.816+0000 7f75ffc37ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:02:04.859 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.816+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.870 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.828+0000 7f75ffc37ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:02:04.870 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.828+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.881 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.839+0000 7f75ffc37ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:02:04.882 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.839+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.851+0000 7f75ffc37ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:02:04.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.851+0000 7f75ffc37ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:02:04.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.851+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.899 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.856+0000 7f75ffc37ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:02:04.899 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.856+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.909 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.867+0000 7f75ffc37ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:02:04.909 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.867+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.878+0000 7f75ffc37ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:02:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.878+0000 7f75ffc37ec0 20 zonegroup default 2019-11-25T10:02:04.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.879+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.885+0000 7f75ffc37ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:02:04.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.885+0000 7f75ffc37ec0 10 Cannot find current period zone using local zone 2019-11-25T10:02:04.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.885+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.933 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.890+0000 7f75ffc37ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:02:04.933 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.891+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.900+0000 7f75ffc37ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:02:04.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.900+0000 7f75ffc37ec0 20 rados->read ofs=0 len=0 2019-11-25T10:02:04.952 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.910+0000 7f75ffc37ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:02:04.952 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.910+0000 7f75ffc37ec0 20 zone default found 2019-11-25T10:02:04.953 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.910+0000 7f75ffc37ec0 20 started sync module instance, tier type = 2019-11-25T10:02:04.953 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:04.910+0000 7f75ffc37ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:02:05.368 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.326+0000 7f75ffc37ec0 20 add_watcher() i=0 2019-11-25T10:02:05.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.326+0000 7f75ffc37ec0 20 add_watcher() i=1 2019-11-25T10:02:05.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.326+0000 7f75ffc37ec0 20 add_watcher() i=2 2019-11-25T10:02:05.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.326+0000 7f75ffc37ec0 20 add_watcher() i=3 2019-11-25T10:02:05.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.326+0000 7f75ffc37ec0 20 add_watcher() i=4 2019-11-25T10:02:05.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.326+0000 7f75ffc37ec0 20 add_watcher() i=5 2019-11-25T10:02:05.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.326+0000 7f75ffc37ec0 20 add_watcher() i=6 2019-11-25T10:02:05.412 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.370+0000 7f75ffc37ec0 20 add_watcher() i=7 2019-11-25T10:02:05.413 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.370+0000 7f75ffc37ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:02:05.413 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.370+0000 7f75bd7e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:02:05.427 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.384+0000 7f75ece65700 0 -- 172.21.15.135:0/3937318540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c1db60a40 msgr2=0x556c1db309f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:02:05.469 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:05.426+0000 7f75ec664700 0 -- 172.21.15.135:0/3904056803 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x556c1db283a0 msgr2=0x556c1db287b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:02:07.457 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.413+0000 7f752f7fe700 20 reqs_thread_entry: start 2019-11-25T10:02:07.457 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.413+0000 7f752d7fa700 20 reqs_thread_entry: start 2019-11-25T10:02:07.457 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.413+0000 7f75ffc37ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:02:07.457 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.414+0000 7f751b7fe700 20 reqs_thread_entry: start 2019-11-25T10:02:07.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.414+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T10:02:07.522 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.478+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:07.545 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.502+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:07.549 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:37:20.697 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:02:07.556 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.513+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:07.557 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:37:20.705 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:02:07.564 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:37:20.713 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:02:07.565 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:37:20.818 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:02:07.570 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:37:20.823 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:02:07.573 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:37:20.721 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:02:07.592 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.548+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T10:02:07.634 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.591+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:07.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.610+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:07.662 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.618+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:07.696 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.652+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T10:02:07.733 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:37:20.986 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:02:07.736 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.693+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:07.755 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.711+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:07.757 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:37:20.905 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:02:07.766 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.722+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:07.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.766+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T10:02:07.812 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:37:20.960 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:02:07.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.809+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:07.869 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.826+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:07.878 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.835+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:07.918 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.875+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T10:02:07.960 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.917+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:07.977 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.934+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:07.986 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.943+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.017 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:07.974+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T10:02:08.086 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.042+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.065+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:08.119 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.076+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.174 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.131+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T10:02:08.231 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.187+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.252 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.208+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:08.264 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.221+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.251+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T10:02:08.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.295+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.369 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.325+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:08.377 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.334+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.424 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.381+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T10:02:08.480 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.437+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.497 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.454+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:08.506 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.463+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.539 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.495+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T10:02:08.579 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.535+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.553+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:08.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.561+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.647 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.604+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T10:02:08.691 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.648+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.707 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.663+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:08.716 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.672+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.750 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.707+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T10:02:08.799 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.755+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.814 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.771+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:08.823 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.779+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.861 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.818+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T10:02:08.906 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.863+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.877+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.887+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:08.981 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.937+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T10:02:09.026 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:08.982+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.002+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:09.057 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.014+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.093 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.050+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T10:02:09.137 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.094+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.161 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.117+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:09.176 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.133+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.208 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.165+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T10:02:09.253 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.210+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.231+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:09.288 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.245+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.292+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T10:02:09.381 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.337+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.359+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:09.412 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.369+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.415+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T10:02:09.542 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.498+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.522+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:09.577 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.533+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.629 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.586+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T10:02:09.695 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.652+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.678+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:09.734 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.691+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.773 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.730+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T10:02:09.834 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.790+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.851 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.808+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:09.861 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.817+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:09.917 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.874+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T10:02:09.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.949+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.028 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:09.984+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:10.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.001+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.113 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.069+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T10:02:10.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.138+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.203 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.160+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:10.217 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.174+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.265 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.222+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T10:02:10.332 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.287+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.316+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:10.373 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.330+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.422 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.379+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T10:02:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.454+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.536 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.492+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:10.552 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.509+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.611 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.567+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T10:02:10.679 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.636+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.659+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:10.714 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.671+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.769 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.726+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T10:02:10.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.811+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.878 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.835+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:10.890 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.846+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:10.959 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.915+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T10:02:11.041 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:10.997+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.065 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.022+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:11.086 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.042+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.131 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.087+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T10:02:11.195 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.152+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.228 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.185+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:11.246 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.202+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.310 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.266+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T10:02:11.388 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.345+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.423 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.379+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:11.440 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.397+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.452+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T10:02:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.510+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.574 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.530+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:11.585 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.541+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.666 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.623+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T10:02:11.739 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.695+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.722+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.741+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.826 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.782+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T10:02:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.850+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.880+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:02:11.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.899+0000 7f75ffc37ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:02:12.040 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.997+0000 7f75ffc37ec0 20 remove_watcher() i=0 2019-11-25T10:02:12.041 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:11.997+0000 7f75ffc37ec0 2 removed watcher, disabling cache 2019-11-25T10:02:12.101 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:12.058+0000 7f75ffc37ec0 20 remove_watcher() i=1 2019-11-25T10:02:12.165 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:12.122+0000 7f75ffc37ec0 20 remove_watcher() i=2 2019-11-25T10:02:12.234 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:12.190+0000 7f75ffc37ec0 20 remove_watcher() i=3 2019-11-25T10:02:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:12.239+0000 7f75ffc37ec0 20 remove_watcher() i=4 2019-11-25T10:02:12.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:12.284+0000 7f75ffc37ec0 20 remove_watcher() i=5 2019-11-25T10:02:12.392 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:12.349+0000 7f75ffc37ec0 20 remove_watcher() i=6 2019-11-25T10:02:12.441 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:02:12.397+0000 7f75ffc37ec0 20 remove_watcher() i=7 2019-11-25T10:02:12.451 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2019-11-25T10:02:13.082 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :clean 2019-11-25T10:02:13.678 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :compileJava 2019-11-25T10:02:13.779 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :processResources 2019-11-25T10:02:13.779 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :classes 2019-11-25T10:02:13.980 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:13.980 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :compileTestJava 2019-11-25T10:02:13.980 INFO:teuthology.orchestra.run.smithi135.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-25T10:02:13.981 INFO:teuthology.orchestra.run.smithi135.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-25T10:02:13.981 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:13.981 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :processTestResources NO-SOURCE 2019-11-25T10:02:13.981 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :testClasses 2019-11-25T10:02:16.079 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:16.080 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :test 2019-11-25T10:02:16.080 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:16.080 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2019-11-25T10:02:18.480 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:18.481 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2019-11-25T10:02:24.279 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:24.279 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2019-11-25T10:02:26.479 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:26.479 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2019-11-25T10:02:32.779 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:32.779 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2019-11-25T10:02:33.879 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:33.879 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2019-11-25T10:02:39.679 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:39.679 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2019-11-25T10:02:48.479 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:48.480 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2019-11-25T10:02:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:49.080 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2019-11-25T10:02:52.779 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:02:52.780 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2019-11-25T10:03:02.079 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:03:02.080 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2019-11-25T10:03:02.280 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:03:02.280 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2019-11-25T10:03:03.679 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:03:03.680 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2019-11-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:03:08.080 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2019-11-25T10:03:22.479 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:03:22.479 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2019-11-25T10:03:26.079 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:03:26.079 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2019-11-25T10:03:34.179 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:03:34.179 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2019-11-25T10:03:34.485 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:03:34.485 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2019-11-25T10:03:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:03:35.608 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------- 2019-11-25T10:03:35.608 INFO:teuthology.orchestra.run.smithi135.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2019-11-25T10:03:35.608 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------- 2019-11-25T10:03:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:03:35.608 INFO:teuthology.orchestra.run.smithi135.stdout:BUILD SUCCESSFUL in 1m 23s 2019-11-25T10:03:35.608 INFO:teuthology.orchestra.run.smithi135.stdout:5 actionable tasks: 5 executed 2019-11-25T10:03:35.613 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T10:03:35.733 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:35.731+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:35.782 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:35.780+0000 7f7d30f31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:35.782 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:35.780+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:35.788+0000 7f7d30f31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:35.788+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:35.794+0000 7f7d30f31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:35.795+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:35.816 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:35.814+0000 7f7d30f31ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:36.023 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.021+0000 7f7d30f31ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:03:36.023 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.021+0000 7f7d30f31ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:03:36.023 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.021+0000 7f7d30f31ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:03:36.023 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.021+0000 7f7d30f31ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:03:36.023 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.021+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.037+0000 7f7d30f31ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:36.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.037+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.054 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.052+0000 7f7d30f31ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:03:36.054 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.052+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.076 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.075+0000 7f7d30f31ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:36.077 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.075+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.093+0000 7f7d30f31ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:03:36.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.093+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.103 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.101+0000 7f7d30f31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:36.103 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.101+0000 7f7d30f31ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:03:36.103 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.101+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.110 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.108+0000 7f7d30f31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:36.110 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.108+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.139 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.137+0000 7f7d30f31ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:36.139 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.137+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.148 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.147+0000 7f7d30f31ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:03:36.149 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.147+0000 7f7d30f31ec0 20 zonegroup default 2019-11-25T10:03:36.149 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.147+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.154+0000 7f7d30f31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:36.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.154+0000 7f7d30f31ec0 10 Cannot find current period zone using local zone 2019-11-25T10:03:36.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.154+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.165 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.164+0000 7f7d30f31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:36.165 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.164+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.178+0000 7f7d30f31ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:36.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.178+0000 7f7d30f31ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:36.189 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.187+0000 7f7d30f31ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:03:36.189 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.187+0000 7f7d30f31ec0 20 zone default found 2019-11-25T10:03:36.189 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.187+0000 7f7d30f31ec0 20 started sync module instance, tier type = 2019-11-25T10:03:36.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.187+0000 7f7d30f31ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:03:36.612 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.610+0000 7f7d30f31ec0 20 add_watcher() i=0 2019-11-25T10:03:36.612 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.610+0000 7f7d30f31ec0 20 add_watcher() i=1 2019-11-25T10:03:36.612 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.610+0000 7f7d30f31ec0 20 add_watcher() i=2 2019-11-25T10:03:36.612 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.610+0000 7f7d30f31ec0 20 add_watcher() i=3 2019-11-25T10:03:36.612 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.610+0000 7f7d30f31ec0 20 add_watcher() i=4 2019-11-25T10:03:36.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.610+0000 7f7d30f31ec0 20 add_watcher() i=5 2019-11-25T10:03:36.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.610+0000 7f7d30f31ec0 20 add_watcher() i=6 2019-11-25T10:03:36.648 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.646+0000 7f7d30f31ec0 20 add_watcher() i=7 2019-11-25T10:03:36.649 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.646+0000 7f7d30f31ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:03:36.649 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.646+0000 7f7cedfeb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:03:36.650 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.649+0000 7f7d1e15f700 0 -- >> v2:172.21.15.174:3300/0 conn(0x557b8af95b60 msgr2=0x557b8af97f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T10:03:36.694 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:36.692+0000 7f7d1e960700 0 -- 172.21.15.135:0/2100760496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b8af8bb80 msgr2=0x557b8af59f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:03:37.752 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.750+0000 7f7c5ffff700 20 reqs_thread_entry: start 2019-11-25T10:03:37.752 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.750+0000 7f7c5dffb700 20 reqs_thread_entry: start 2019-11-25T10:03:37.752 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.750+0000 7f7d30f31ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:03:37.753 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.751+0000 7f7c4bfff700 20 reqs_thread_entry: start 2019-11-25T10:03:37.753 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.751+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T10:03:37.813 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.812+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:37.836 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.835+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:37.846 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.845+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:37.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.886+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T10:03:37.939 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.937+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:37.959 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.958+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:37.972 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:37.970+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.011 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.009+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T10:03:38.057 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.056+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.081 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.075+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:38.087 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.085+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.127+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T10:03:38.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.191+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.219 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.217+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:38.238 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.236+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.279 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.276+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T10:03:38.323 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.322+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.343 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.340+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:38.351 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.350+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.388+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T10:03:38.444 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.442+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.467+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:38.486 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.484+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.531 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.520+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T10:03:38.575 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.573+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.606 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.604+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:38.617 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.616+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.651+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T10:03:38.692 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.689+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.712 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.710+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:38.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.724+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.766 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.765+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T10:03:38.840 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.838+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.859 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.858+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:38.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.869+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:38.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.915+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T10:03:38.984 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:38.983+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.002 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.001+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:39.012 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.010+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.048 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.046+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T10:03:39.118 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.116+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.139 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.138+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:39.149 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.148+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.180+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T10:03:39.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.238+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.256 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.254+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:39.267 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.265+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.301 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.300+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T10:03:39.407 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.406+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.436 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.435+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:39.448 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.446+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.497 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.495+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T10:03:39.560 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.559+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.587+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:39.607 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.606+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.648 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.647+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T10:03:39.715 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.712+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.734 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.732+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:39.744 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.743+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.787 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.785+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T10:03:39.868 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.866+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.902 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.899+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:39.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.914+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:39.979 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:39.977+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T10:03:40.017 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.015+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.033 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.031+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:40.044 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.043+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.080 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.079+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T10:03:40.141 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.139+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.170 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.168+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:40.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.178+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.246 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.245+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T10:03:40.305 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.304+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.334+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:40.346 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.345+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.408 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.406+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T10:03:40.493 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.492+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.520 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.518+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:40.531 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.530+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.600 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.599+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T10:03:40.685 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.683+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.713 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.711+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:40.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.724+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.764 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.763+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T10:03:40.808 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.807+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.825 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.823+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:40.834 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.832+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.865 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.863+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T10:03:40.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.917+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.939 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.938+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:40.948 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.946+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:40.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:40.987+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T10:03:41.022 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.021+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.038 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.037+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:41.047 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.045+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.081 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.079+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T10:03:41.158 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.156+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.184 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.183+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:41.215 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.214+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.262 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.260+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T10:03:41.318 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.316+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.339 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.337+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:41.348 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.346+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.385 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.384+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T10:03:41.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.452+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.471 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.470+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:41.480 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.479+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.518 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.517+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T10:03:41.610 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.609+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.636 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.635+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:41.650 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.648+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.692 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.690+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T10:03:41.737 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.735+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.757 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.755+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:41.768 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.767+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.805+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T10:03:41.860 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.858+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.878 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.876+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:41.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.884+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:41.925 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.924+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T10:03:41.995 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:41.994+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:42.031 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.030+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:42.048 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.046+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:42.111 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.109+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T10:03:42.188 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.187+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:42.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.213+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:42.245 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.243+0000 7f7d30f31ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:42.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.358+0000 7f7d30f31ec0 20 remove_watcher() i=0 2019-11-25T10:03:42.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.358+0000 7f7d30f31ec0 2 removed watcher, disabling cache 2019-11-25T10:03:42.448 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.446+0000 7f7d30f31ec0 20 remove_watcher() i=1 2019-11-25T10:03:42.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.497+0000 7f7d30f31ec0 20 remove_watcher() i=2 2019-11-25T10:03:42.564 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.563+0000 7f7d30f31ec0 20 remove_watcher() i=3 2019-11-25T10:03:42.618 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.616+0000 7f7d30f31ec0 20 remove_watcher() i=4 2019-11-25T10:03:42.676 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.674+0000 7f7d30f31ec0 20 remove_watcher() i=5 2019-11-25T10:03:42.738 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.736+0000 7f7d30f31ec0 20 remove_watcher() i=6 2019-11-25T10:03:42.785 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.783+0000 7f7d30f31ec0 20 remove_watcher() i=7 2019-11-25T10:03:42.794 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T10:03:42.936 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.935+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:42.969 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.967+0000 7fd6f3b64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:42.969 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.967+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:42.980 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.977+0000 7fd6f3b64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:42.980 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.977+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:42.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.987+0000 7fd6f3b64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:42.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:42.987+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.040 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.039+0000 7fd6f3b64ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:43.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.297+0000 7fd6f3b64ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:03:43.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.297+0000 7fd6f3b64ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:03:43.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.297+0000 7fd6f3b64ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:03:43.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.297+0000 7fd6f3b64ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:03:43.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.297+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.318 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.316+0000 7fd6f3b64ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:43.318 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.316+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.334 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.333+0000 7fd6f3b64ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:03:43.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.333+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.349 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.347+0000 7fd6f3b64ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:43.349 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.347+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.365+0000 7fd6f3b64ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:03:43.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.365+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.375+0000 7fd6f3b64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:43.376 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.375+0000 7fd6f3b64ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:03:43.377 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.375+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.385 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.384+0000 7fd6f3b64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:43.385 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.384+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.402+0000 7fd6f3b64ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:43.404 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.402+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.420 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.418+0000 7fd6f3b64ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:03:43.420 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.418+0000 7fd6f3b64ec0 20 zonegroup default 2019-11-25T10:03:43.420 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.418+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.429 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.427+0000 7fd6f3b64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:43.429 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.427+0000 7fd6f3b64ec0 10 Cannot find current period zone using local zone 2019-11-25T10:03:43.429 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.427+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.438 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.436+0000 7fd6f3b64ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:43.438 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.436+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.451 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.449+0000 7fd6f3b64ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:43.451 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.449+0000 7fd6f3b64ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:43.467 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.465+0000 7fd6f3b64ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:03:43.467 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.465+0000 7fd6f3b64ec0 20 zone default found 2019-11-25T10:03:43.467 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.465+0000 7fd6f3b64ec0 20 started sync module instance, tier type = 2019-11-25T10:03:43.467 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.465+0000 7fd6f3b64ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:03:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.777+0000 7fd6e0591700 0 -- 172.21.15.135:0/1556535217 >> [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] conn(0x55aa190cc910 msgr2=0x55aa190ced30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:03:43.852 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.850+0000 7fd6f3b64ec0 20 add_watcher() i=0 2019-11-25T10:03:43.852 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.850+0000 7fd6f3b64ec0 20 add_watcher() i=1 2019-11-25T10:03:43.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.850+0000 7fd6f3b64ec0 20 add_watcher() i=2 2019-11-25T10:03:43.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.850+0000 7fd6f3b64ec0 20 add_watcher() i=3 2019-11-25T10:03:43.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.850+0000 7fd6f3b64ec0 20 add_watcher() i=4 2019-11-25T10:03:43.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.850+0000 7fd6f3b64ec0 20 add_watcher() i=5 2019-11-25T10:03:43.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.854+0000 7fd6f3b64ec0 20 add_watcher() i=6 2019-11-25T10:03:43.883 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.882+0000 7fd6f3b64ec0 20 add_watcher() i=7 2019-11-25T10:03:43.883 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.882+0000 7fd6f3b64ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:03:43.884 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.882+0000 7fd6b17e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:03:43.899 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:43.898+0000 7fd6e0591700 0 -- 172.21.15.135:0/1593924108 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55aa190e8690 msgr2=0x55aa190e8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:03:45.488 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.486+0000 7fd6237fe700 20 reqs_thread_entry: start 2019-11-25T10:03:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.487+0000 7fd6217fa700 20 reqs_thread_entry: start 2019-11-25T10:03:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.487+0000 7fd6f3b64ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:03:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.488+0000 7fd60f7fe700 20 reqs_thread_entry: start 2019-11-25T10:03:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.488+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T10:03:45.590 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.588+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:45.626 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.625+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:45.639 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.637+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:45.684 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.683+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T10:03:45.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.745+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:45.768 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.766+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:45.786 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.785+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.854+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T10:03:45.910 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.909+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:45.930 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.928+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:45.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.939+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:45.977+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T10:03:46.019 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.018+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.035 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.034+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:46.043 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.042+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.084 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.082+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T10:03:46.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.162+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.202 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.201+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:46.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.218+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.271 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.269+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T10:03:46.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.343+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.377 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.376+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:46.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.388+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.443 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.442+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T10:03:46.521 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.519+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.552 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.551+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:46.570 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.569+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.634 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.633+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T10:03:46.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.719+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.775 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.774+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:46.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.804+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.887+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T10:03:46.956 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.956+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:46.984 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.984+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:46.996 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:46.995+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.059 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.059+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T10:03:47.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.156+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.198 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.198+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:47.218 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.217+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.285+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T10:03:47.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.360+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.388 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.387+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:47.399 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.399+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.459 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.459+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T10:03:47.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.535+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.562+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:47.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.574+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.616 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.615+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T10:03:47.676 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.676+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.694 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.694+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.702+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.740 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.739+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T10:03:47.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.819+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.854 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.854+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:47.875 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.874+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:47.932 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:47.932+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T10:03:48.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.014+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.041 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.041+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:48.055 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.055+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.108+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T10:03:48.166 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.166+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.198 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.198+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:48.218 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.218+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.274+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T10:03:48.343 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.342+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.364 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.364+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:48.379 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.378+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.419 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.418+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T10:03:48.469 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.468+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.487 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.486+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:48.496 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.496+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.532 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.532+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T10:03:48.609 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.608+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.633+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:48.647 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.646+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.699+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T10:03:48.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.746+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.764 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.764+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:48.776 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.776+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.818 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.818+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T10:03:48.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.876+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.892 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.892+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:48.901 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.901+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:48.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:48.945+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T10:03:49.021 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.021+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.054+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:49.069 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.069+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.125 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.125+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T10:03:49.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.179+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.199 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.199+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:49.210 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.209+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.246 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.246+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T10:03:49.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.299+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.326+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:49.342 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.342+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.397 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.397+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T10:03:49.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.452+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.473 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.473+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:49.481 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.480+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.551 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.550+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T10:03:49.621 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.620+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.651 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.650+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:49.679 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.678+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.718 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.718+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T10:03:49.765 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.765+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.781 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.781+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:49.791 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.791+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.837 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.837+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T10:03:49.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.887+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.907 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.907+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:49.918 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.918+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:49.949 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:49.949+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T10:03:50.010 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.010+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:50.038 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.037+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:50.050 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.049+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:50.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.094+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T10:03:50.173 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.173+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:50.207 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.207+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:50.221 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.221+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:50.281 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.281+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T10:03:50.368 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.368+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:50.395 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.394+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:50.410 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.410+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:50.459 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.459+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T10:03:50.536 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.535+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:50.562 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.561+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:50.574 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.574+0000 7fd6f3b64ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:50.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.677+0000 7fd6f3b64ec0 20 remove_watcher() i=0 2019-11-25T10:03:50.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.677+0000 7fd6f3b64ec0 2 removed watcher, disabling cache 2019-11-25T10:03:50.741 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.740+0000 7fd6f3b64ec0 20 remove_watcher() i=1 2019-11-25T10:03:50.804 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.804+0000 7fd6f3b64ec0 20 remove_watcher() i=2 2019-11-25T10:03:50.862 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.861+0000 7fd6f3b64ec0 20 remove_watcher() i=3 2019-11-25T10:03:50.919 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.918+0000 7fd6f3b64ec0 20 remove_watcher() i=4 2019-11-25T10:03:50.981 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:50.981+0000 7fd6f3b64ec0 20 remove_watcher() i=5 2019-11-25T10:03:51.038 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.038+0000 7fd6f3b64ec0 20 remove_watcher() i=6 2019-11-25T10:03:51.076 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.076+0000 7fd6f3b64ec0 20 remove_watcher() i=7 2019-11-25T10:03:51.086 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T10:03:51.224 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.223+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.256 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.256+0000 7fdf5faf5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:51.256 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.256+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.264+0000 7fdf5faf5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.264+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.272 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.272+0000 7fdf5faf5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:51.272 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.272+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.290 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.290+0000 7fdf5faf5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:51.457 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.457+0000 7fdf5faf5ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:03:51.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.457+0000 7fdf5faf5ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:03:51.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.457+0000 7fdf5faf5ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:03:51.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.457+0000 7fdf5faf5ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:03:51.458 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.457+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.474 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.474+0000 7fdf5faf5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:51.475 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.474+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.493+0000 7fdf5faf5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:03:51.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.493+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.508 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.508+0000 7fdf5faf5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:51.509 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.508+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.520 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.520+0000 7fdf5faf5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:03:51.520 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.520+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.533 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.532+0000 7fdf5faf5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:51.533 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.532+0000 7fdf5faf5ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:03:51.533 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.532+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.543 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.542+0000 7fdf5faf5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:51.543 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.542+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.559 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.559+0000 7fdf5faf5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:51.559 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.559+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.574 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.574+0000 7fdf5faf5ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:03:51.574 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.574+0000 7fdf5faf5ec0 20 zonegroup default 2019-11-25T10:03:51.575 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.574+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.587+0000 7fdf5faf5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.587+0000 7fdf5faf5ec0 10 Cannot find current period zone using local zone 2019-11-25T10:03:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.587+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.594 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.593+0000 7fdf5faf5ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:51.594 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.593+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.603+0000 7fdf5faf5ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:51.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.603+0000 7fdf5faf5ec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:51.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.612+0000 7fdf5faf5ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:03:51.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.612+0000 7fdf5faf5ec0 20 zone default found 2019-11-25T10:03:51.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.612+0000 7fdf5faf5ec0 20 started sync module instance, tier type = 2019-11-25T10:03:51.614 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.612+0000 7fdf5faf5ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:03:51.962 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.962+0000 7fdf5faf5ec0 20 add_watcher() i=0 2019-11-25T10:03:51.962 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.962+0000 7fdf5faf5ec0 20 add_watcher() i=1 2019-11-25T10:03:51.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.962+0000 7fdf5faf5ec0 20 add_watcher() i=2 2019-11-25T10:03:51.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.962+0000 7fdf5faf5ec0 20 add_watcher() i=3 2019-11-25T10:03:51.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.962+0000 7fdf5faf5ec0 20 add_watcher() i=4 2019-11-25T10:03:51.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.962+0000 7fdf5faf5ec0 20 add_watcher() i=5 2019-11-25T10:03:51.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.965+0000 7fdf5faf5ec0 20 add_watcher() i=6 2019-11-25T10:03:51.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.992+0000 7fdf5faf5ec0 20 add_watcher() i=7 2019-11-25T10:03:51.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.992+0000 7fdf5faf5ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:03:51.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.993+0000 7fdf1cfe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:03:51.997 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:51.997+0000 7fdf4cd23700 0 -- 172.21.15.135:0/2348363000 >> v1:172.21.15.174:6789/0 conn(0x561f4f9609b0 legacy=0x561f4f95e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T10:03:52.040 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:52.039+0000 7fdf47fff700 0 -- 172.21.15.135:0/2102555818 >> [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] conn(0x561f4f9a21e0 msgr2=0x561f4f9a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-25T10:03:53.728 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.727+0000 7fde8effd700 20 reqs_thread_entry: start 2019-11-25T10:03:53.728 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.727+0000 7fde8cff9700 20 reqs_thread_entry: start 2019-11-25T10:03:53.728 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.727+0000 7fdf5faf5ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:03:53.729 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.728+0000 7fde82ffd700 20 reqs_thread_entry: start 2019-11-25T10:03:53.729 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.728+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T10:03:53.784 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.783+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:53.800 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.800+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:53.811 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.808+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.842+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T10:03:53.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.886+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:53.905 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.905+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:53.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.915+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:53.949 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:53.949+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T10:03:54.006 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.006+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.030 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.030+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:54.038 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.038+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.072 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.072+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T10:03:54.120 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.119+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.136 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.135+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:54.143 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.143+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.180+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T10:03:54.260 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.259+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.282 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.282+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:54.295 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.295+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.335+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T10:03:54.410 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.410+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.433 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.433+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:54.444 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.444+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.494+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T10:03:54.543 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.543+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.562 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.562+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:54.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.581+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.616+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T10:03:54.661 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.661+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.678+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:54.687 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.686+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.723 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.723+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T10:03:54.801 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.801+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.825 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.825+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:54.846 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.846+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.883 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.883+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T10:03:54.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.941+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:54.962 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.962+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:54.969 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:54.969+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.026 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.025+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T10:03:55.086 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.086+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.107 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.107+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:55.118 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.118+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.160 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.160+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T10:03:55.223 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.223+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.246 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.246+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:55.260 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.260+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.297 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.296+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T10:03:55.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.345+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.366+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:55.376 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.376+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.411 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.411+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T10:03:55.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.451+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.476+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:55.486 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.486+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.516 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.516+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T10:03:55.554 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.554+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.571 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.571+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:55.582 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.582+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.621 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.621+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T10:03:55.679 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.679+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.717 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.717+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:55.737 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.737+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.780 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.779+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T10:03:55.825 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.825+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.851 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.850+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:55.864 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.864+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.918+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T10:03:55.978 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.978+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:55.998 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:55.998+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:56.007 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.007+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.038 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.038+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T10:03:56.127 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.127+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.154+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.165+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.199 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.199+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T10:03:56.289 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.289+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.323 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.323+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:56.337 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.337+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.386 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.386+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T10:03:56.460 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.460+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.489 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.489+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:56.504 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.504+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.551 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.550+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T10:03:56.612 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.612+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.649 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.648+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:56.667 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.667+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.725+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T10:03:56.781 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.776+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.795 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.795+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:56.807 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.807+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.841 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.841+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T10:03:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.885+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.903+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.913+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:56.945 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:56.945+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T10:03:57.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.014+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.034+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:57.046 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.046+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.091 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.091+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T10:03:57.156 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.155+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.172 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.171+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:57.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.183+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.230 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.230+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T10:03:57.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.284+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.302 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.302+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:57.312 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.312+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.360+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T10:03:57.438 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.438+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.474 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.474+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:57.492 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.492+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.555 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.555+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T10:03:57.616 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.616+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.649 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.649+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:57.660 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.660+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.706 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.706+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T10:03:57.786 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.786+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.807 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.807+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:57.818 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.818+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.905 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.904+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T10:03:57.966 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.966+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:57.994 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:57.994+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:58.006 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.006+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:58.048 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.047+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T10:03:58.106 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.106+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:58.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.128+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:03:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.142+0000 7fdf5faf5ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:03:58.237 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.237+0000 7fdf5faf5ec0 20 remove_watcher() i=0 2019-11-25T10:03:58.238 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.237+0000 7fdf5faf5ec0 2 removed watcher, disabling cache 2019-11-25T10:03:58.308 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.308+0000 7fdf5faf5ec0 20 remove_watcher() i=1 2019-11-25T10:03:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.362+0000 7fdf5faf5ec0 20 remove_watcher() i=2 2019-11-25T10:03:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.434+0000 7fdf5faf5ec0 20 remove_watcher() i=3 2019-11-25T10:03:58.493 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.493+0000 7fdf5faf5ec0 20 remove_watcher() i=4 2019-11-25T10:03:58.557 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.550+0000 7fdf5faf5ec0 20 remove_watcher() i=5 2019-11-25T10:03:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.614+0000 7fdf5faf5ec0 20 remove_watcher() i=6 2019-11-25T10:03:58.660 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.660+0000 7fdf5faf5ec0 20 remove_watcher() i=7 2019-11-25T10:03:58.672 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T10:03:58.819 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.819+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:58.854 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.854+0000 7f3be229aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:58.854 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.854+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:58.863 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.863+0000 7f3be229aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:58.863 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.863+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.871+0000 7f3be229aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.871+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:58.890+0000 7f3be229aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:59.146 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.146+0000 7f3be229aec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:03:59.146 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.146+0000 7f3be229aec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:03:59.146 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.146+0000 7f3be229aec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:03:59.146 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.146+0000 7f3be229aec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:03:59.146 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.146+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.164 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.164+0000 7f3be229aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:59.164 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.164+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.177 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.176+0000 7f3be229aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:03:59.177 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.177+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.188 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.188+0000 7f3be229aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:59.188 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.188+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.201 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.200+0000 7f3be229aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:03:59.201 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.201+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.208 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.207+0000 7f3be229aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:59.208 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.207+0000 7f3be229aec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:03:59.208 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.207+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.214+0000 7f3be229aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:59.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.214+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.226 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.226+0000 7f3be229aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:59.226 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.226+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.237+0000 7f3be229aec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:03:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.237+0000 7f3be229aec0 20 zonegroup default 2019-11-25T10:03:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.237+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.245 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.245+0000 7f3be229aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:59.245 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.245+0000 7f3be229aec0 10 Cannot find current period zone using local zone 2019-11-25T10:03:59.245 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.245+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.254 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.254+0000 7f3be229aec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:03:59.254 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.254+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.267 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.267+0000 7f3be229aec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:03:59.268 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.267+0000 7f3be229aec0 20 rados->read ofs=0 len=0 2019-11-25T10:03:59.280 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.280+0000 7f3be229aec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:03:59.281 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.280+0000 7f3be229aec0 20 zone default found 2019-11-25T10:03:59.281 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.280+0000 7f3be229aec0 20 started sync module instance, tier type = 2019-11-25T10:03:59.281 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.280+0000 7f3be229aec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:03:59.627 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.627+0000 7f3be229aec0 20 add_watcher() i=0 2019-11-25T10:03:59.628 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.627+0000 7f3be229aec0 20 add_watcher() i=1 2019-11-25T10:03:59.628 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.627+0000 7f3be229aec0 20 add_watcher() i=2 2019-11-25T10:03:59.628 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.627+0000 7f3be229aec0 20 add_watcher() i=3 2019-11-25T10:03:59.628 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.627+0000 7f3be229aec0 20 add_watcher() i=4 2019-11-25T10:03:59.629 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.627+0000 7f3be229aec0 20 add_watcher() i=5 2019-11-25T10:03:59.629 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.627+0000 7f3be229aec0 20 add_watcher() i=6 2019-11-25T10:03:59.663 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.663+0000 7f3be229aec0 20 add_watcher() i=7 2019-11-25T10:03:59.663 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.663+0000 7f3be229aec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:03:59.663 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.663+0000 7f3b9ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:03:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.676+0000 7f3bcf4c8700 0 -- 172.21.15.135:0/1174027983 >> v2:172.21.15.174:3300/0 conn(0x55d8092405f0 msgr2=0x55d809242a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T10:03:59.880 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.879+0000 7f3bcf4c8700 0 --2- 172.21.15.135:0/1174027983 >> v2:172.21.15.174:3300/0 conn(0x55d8092405f0 0x55d809242a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-25T10:03:59.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:03:59.928+0000 7f3bcfcc9700 0 -- 172.21.15.135:0/1727965787 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55d809236540 msgr2=0x55d8092358d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:04:01.735 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:01.735+0000 7f3b0e7fc700 20 reqs_thread_entry: start 2019-11-25T10:04:01.736 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:01.735+0000 7f3b0cff9700 20 reqs_thread_entry: start 2019-11-25T10:04:01.736 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:01.735+0000 7f3be229aec0 20 init_complete bucket index max shards: 0 2019-11-25T10:04:01.736 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:01.736+0000 7f3b06ffd700 20 reqs_thread_entry: start 2019-11-25T10:04:01.737 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:01.736+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T10:04:01.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:01.810+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:01.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:01.833+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:01.842 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:01.842+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:01.900 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:01.900+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T10:04:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:01.977+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.002 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.002+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:02.015 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.015+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.079 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.079+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T10:04:02.158 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.158+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.182+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:02.195 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.195+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.253 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.253+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T10:04:02.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.335+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.359+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:02.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.370+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.409+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T10:04:02.467 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.467+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.490 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.490+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:02.503 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.503+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.546 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.546+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T10:04:02.655 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.655+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.699 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.699+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:02.717 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.716+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.772 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.770+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T10:04:02.842 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.842+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.868 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.867+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:02.882 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.882+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:02.939 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:02.939+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T10:04:03.003 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.003+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.029 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.029+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:03.042 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.042+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.088 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.088+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T10:04:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.230+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.248 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.248+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.258+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.299 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.299+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T10:04:03.360 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.360+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.383 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.383+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:03.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.396+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.441+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T10:04:03.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.502+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.519 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.519+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:03.529 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.529+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.561 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.561+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T10:04:03.615 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.613+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.631 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.631+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:03.640 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.640+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.677 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.677+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T10:04:03.770 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.770+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.792 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.791+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:03.799 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.799+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.845 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.845+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T10:04:03.931 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.931+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:03.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.963+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:03.977 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:03.977+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.021 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.020+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T10:04:04.069 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.069+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.085+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:04.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.094+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.129+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.225+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.251+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:04.266 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.266+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.322 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.322+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T10:04:04.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.400+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.431 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.431+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:04.446 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.446+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.497+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T10:04:04.568 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.568+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.607 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.607+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:04.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.623+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.681+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T10:04:04.764 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.765+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.801 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.801+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:04.819 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.819+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.883 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.883+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T10:04:04.947 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.947+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:04.974 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.974+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:04.991 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:04.991+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.050 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.050+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T10:04:05.120 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.120+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.142+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:05.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.157+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.206 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.206+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T10:04:05.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.285+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.318 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.318+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:05.343 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.343+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.405 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.405+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T10:04:05.464 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.464+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.486 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.487+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:05.499 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.499+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.538 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.538+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T10:04:05.627 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.627+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.648 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.648+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:05.661 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.661+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.706 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.706+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T10:04:05.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.762+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.786 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.786+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:05.798 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.798+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.838 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.838+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T10:04:05.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.890+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.918 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.917+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:05.926 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.926+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:05.960 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:05.959+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T10:04:06.007 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.007+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.030 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.030+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:06.042 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.043+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.086+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T10:04:06.135 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.135+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.168 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.160+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:06.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.184+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.237 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.238+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T10:04:06.315 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.315+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.341 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.341+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:06.355 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.355+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.433 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.433+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T10:04:06.497 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.497+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.522 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.522+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:06.533 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.534+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.582 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.582+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T10:04:06.647 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.647+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.680 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.681+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.695+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.767 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.767+0000 7f3be229aec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T10:04:06.821 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.821+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.843 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.843+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:04:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.853+0000 7f3be229aec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:04:06.958 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.958+0000 7f3be229aec0 20 remove_watcher() i=0 2019-11-25T10:04:06.958 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:06.958+0000 7f3be229aec0 2 removed watcher, disabling cache 2019-11-25T10:04:07.017 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:07.017+0000 7f3be229aec0 20 remove_watcher() i=1 2019-11-25T10:04:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:07.119+0000 7f3be229aec0 20 remove_watcher() i=2 2019-11-25T10:04:07.189 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:07.189+0000 7f3be229aec0 20 remove_watcher() i=3 2019-11-25T10:04:07.237 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:07.237+0000 7f3be229aec0 20 remove_watcher() i=4 2019-11-25T10:04:07.272 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:07.271+0000 7f3be229aec0 20 remove_watcher() i=5 2019-11-25T10:04:07.329 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:07.330+0000 7f3be229aec0 20 remove_watcher() i=6 2019-11-25T10:04:07.378 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:04:07.378+0000 7f3be229aec0 20 remove_watcher() i=7 2019-11-25T10:04:07.385 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2019-11-25T10:04:08.025 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :clean 2019-11-25T10:04:08.622 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :compileJava 2019-11-25T10:04:08.622 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :processResources 2019-11-25T10:04:08.623 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :classes 2019-11-25T10:04:08.824 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:04:08.824 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :compileTestJava 2019-11-25T10:04:08.824 INFO:teuthology.orchestra.run.smithi135.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-11-25T10:04:08.824 INFO:teuthology.orchestra.run.smithi135.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-11-25T10:04:08.824 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:04:08.825 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :processTestResources NO-SOURCE 2019-11-25T10:04:08.825 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :testClasses 2019-11-25T10:04:11.122 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:04:11.122 INFO:teuthology.orchestra.run.smithi135.stdout:> Task :test 2019-11-25T10:04:11.122 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:04:11.123 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2019-11-25T10:04:17.721 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:04:17.722 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2019-11-25T10:04:29.922 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:04:29.922 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2019-11-25T10:04:33.421 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:04:33.422 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2019-11-25T10:04:40.721 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:04:40.721 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2019-11-25T10:04:42.621 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:04:42.621 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2019-11-25T10:04:48.921 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:04:48.922 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2019-11-25T10:05:12.120 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:12.121 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2019-11-25T10:05:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:16.220 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2019-11-25T10:05:18.620 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:18.620 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2019-11-25T10:05:24.420 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:24.420 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2019-11-25T10:05:29.120 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:29.120 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2019-11-25T10:05:33.819 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2019-11-25T10:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:34.120 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2019-11-25T10:05:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:35.620 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2019-11-25T10:05:38.720 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:38.720 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2019-11-25T10:05:45.124 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:45.125 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2019-11-25T10:05:51.219 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:05:51.220 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2019-11-25T10:06:00.719 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:00.719 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2019-11-25T10:06:02.919 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:02.919 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2019-11-25T10:06:11.519 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:11.519 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2019-11-25T10:06:15.319 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:15.319 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2019-11-25T10:06:23.918 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:23.918 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2019-11-25T10:06:26.118 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:26.119 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2019-11-25T10:06:32.918 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:32.918 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2019-11-25T10:06:34.518 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:34.518 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2019-11-25T10:06:42.418 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:42.418 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2019-11-25T10:06:44.918 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:44.919 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2019-11-25T10:06:49.618 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:49.619 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2019-11-25T10:06:50.918 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:50.918 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2019-11-25T10:06:56.818 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:06:56.818 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2019-11-25T10:07:02.418 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:07:02.418 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2019-11-25T10:07:07.018 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:07:07.018 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2019-11-25T10:07:19.260 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:42:32.413 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:19.289 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:42:32.441 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:19.308 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:42:32.461 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:19.309 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:42:32.462 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:19.348 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:42:32.600 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:19.355 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:42:32.606 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:19.414 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:42:32.566 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:19.429 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:42:32.582 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:19.504 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:42:32.755 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:20.355 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:42:33.508 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:20.356 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:42:33.509 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:20.365 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:42:33.518 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:20.473 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:42:33.626 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:20.475 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:42:33.627 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:20.493 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:42:33.646 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:20.519 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:42:33.771 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:20.521 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:42:33.773 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:20.542 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:42:33.793 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:07:22.718 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:07:22.718 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2019-11-25T10:07:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:07:36.318 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2019-11-25T10:11:29.715 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:11:29.728 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2019-11-25T10:11:43.515 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:11:43.515 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2019-11-25T10:11:46.114 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:11:46.114 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2019-11-25T10:11:53.113 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:11:53.114 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2019-11-25T10:11:56.814 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:11:56.814 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2019-11-25T10:12:10.013 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:12:10.014 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2019-11-25T10:12:21.014 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:12:21.014 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2019-11-25T10:12:28.013 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:12:28.013 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2019-11-25T10:12:28.313 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:12:28.313 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2019-11-25T10:12:29.413 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:12:29.413 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2019-11-25T10:12:31.981 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:47:45.138 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:12:31.993 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:47:45.150 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:12:32.004 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:47:45.161 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:12:32.008 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:47:45.166 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:12:32.009 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:47:45.260 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:12:32.013 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:47:45.264 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:12:32.212 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:47:45.463 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:12:32.218 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:47:45.376 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:12:32.241 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:47:45.399 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:12:49.355 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T10:12:49.282+0000 41260700 -1 handle_data failed with exit code -5 2019-11-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2019-11-25T10:12:59.412 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:12:59.412 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2019-11-25T10:13:11.612 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:13:11.612 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2019-11-25T10:13:27.612 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:13:27.612 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2019-11-25T10:13:50.511 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:13:50.512 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2019-11-25T10:13:59.811 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:13:59.811 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2019-11-25T10:15:40.697 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:50:53.857 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:15:40.735 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:50:53.895 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:15:40.743 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:50:53.903 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:15:40.758 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:50:53.918 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:15:40.800 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:50:54.050 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:15:40.806 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:50:54.057 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:15:40.824 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:50:53.984 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:15:40.842 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:50:54.002 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:15:40.898 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:50:54.149 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:15:58.111 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:15:58.111 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2019-11-25T10:16:06.810 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:16:06.810 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2019-11-25T10:16:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:16:35.611 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2019-11-25T10:16:44.110 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:16:44.110 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2019-11-25T10:17:02.110 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:02.110 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2019-11-25T10:17:09.810 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:09.810 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2019-11-25T10:17:17.310 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:17.310 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2019-11-25T10:17:38.010 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:38.010 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2019-11-25T10:17:38.510 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:38.510 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2019-11-25T10:17:39.510 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:39.510 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative STARTED 2019-11-25T10:17:40.809 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:40.810 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative PASSED 2019-11-25T10:17:43.910 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:43.910 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2019-11-25T10:17:44.207 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:52:57.367 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:17:44.214 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:52:57.375 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:17:44.223 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:52:57.384 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:17:44.227 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:52:57.388 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:17:44.228 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:52:57.478 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:17:44.233 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:52:57.484 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:17:44.298 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:52:57.459 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:17:44.311 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:52:57.472 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:17:44.350 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:52:57.601 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:17:45.109 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:45.110 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2019-11-25T10:17:48.910 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:48.910 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2019-11-25T10:17:50.610 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:50.610 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2019-11-25T10:17:55.010 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:55.010 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2019-11-25T10:17:56.710 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:17:56.710 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2019-11-25T10:18:00.710 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:18:00.710 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2019-11-25T10:18:01.910 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:18:01.910 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2019-11-25T10:18:06.010 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:18:06.010 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2019-11-25T10:18:10.310 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:18:10.311 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2019-11-25T10:18:17.510 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:18:17.511 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2019-11-25T10:18:20.811 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:18:20.811 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2019-11-25T10:18:28.711 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:18:28.711 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2019-11-25T10:18:36.611 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:18:36.612 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2019-11-25T10:18:49.211 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:18:49.211 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2019-11-25T10:18:55.711 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:18:55.712 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2019-11-25T10:19:08.112 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:19:08.112 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2019-11-25T10:19:15.912 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:19:15.912 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2019-11-25T10:19:29.712 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:19:29.712 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2019-11-25T10:19:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:19:36.312 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2019-11-25T10:19:50.112 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:19:50.112 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2019-11-25T10:19:56.713 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:19:56.713 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2019-11-25T10:20:10.313 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:20:10.313 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2019-11-25T10:20:16.912 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:20:16.913 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2019-11-25T10:20:29.213 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:20:29.213 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2019-11-25T10:20:40.313 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:20:40.313 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2019-11-25T10:20:52.713 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:20:52.713 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2019-11-25T10:21:00.413 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:21:00.413 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2019-11-25T10:21:13.934 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:21:13.934 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2019-11-25T10:21:21.113 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:21:21.113 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2019-11-25T10:21:32.713 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:21:32.713 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2019-11-25T10:21:41.913 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:21:41.913 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2019-11-25T10:21:54.913 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:21:54.913 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2019-11-25T10:22:02.713 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:22:02.713 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2019-11-25T10:22:17.313 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:22:17.313 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2019-11-25T10:22:23.013 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:22:23.013 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2019-11-25T10:22:33.913 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:22:33.913 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2019-11-25T10:22:42.113 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:22:42.113 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2019-11-25T10:22:54.913 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:22:54.913 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2019-11-25T10:22:56.961 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:58:10.119 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:22:56.969 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:58:10.127 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:22:56.987 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:58:10.144 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:22:56.991 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:58:10.242 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:22:56.992 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:58:10.149 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:22:57.009 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:58:10.260 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:22:57.196 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:58:10.354 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:22:57.213 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:58:10.371 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:22:57.230 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:58:10.481 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:23:04.715 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:23:04.715 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2019-11-25T10:23:16.513 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:23:16.513 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2019-11-25T10:23:24.513 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:23:24.513 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2019-11-25T10:23:38.012 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:23:38.013 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2019-11-25T10:23:46.612 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:23:46.613 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2019-11-25T10:23:58.712 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:23:58.713 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2019-11-25T10:24:02.166 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:59:15.324 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:24:02.178 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:59:15.336 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:24:02.212 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:59:15.463 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:24:02.222 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:59:15.380 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:24:02.225 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:59:15.383 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:24:02.237 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:00:59:15.395 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:24:02.253 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:59:15.504 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:24:02.271 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:00:59:15.429 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:24:02.302 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:00:59:15.553 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:24:04.813 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:24:04.813 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2019-11-25T10:24:15.112 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:24:15.112 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2019-11-25T10:24:23.412 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:24:23.412 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2019-11-25T10:24:36.712 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:24:36.712 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2019-11-25T10:24:42.412 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:24:42.412 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2019-11-25T10:24:52.612 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:24:52.612 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2019-11-25T10:24:59.212 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:24:59.212 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2019-11-25T10:25:12.012 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:25:12.012 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2019-11-25T10:25:16.514 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:25:16.514 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2019-11-25T10:25:28.211 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:25:28.212 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2019-11-25T10:25:34.011 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:25:34.012 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2019-11-25T10:25:47.211 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:25:47.211 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2019-11-25T10:25:49.911 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:25:49.911 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2019-11-25T10:25:56.911 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:25:56.912 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2019-11-25T10:25:59.611 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:25:59.611 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2019-11-25T10:26:07.511 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:07.511 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2019-11-25T10:26:11.211 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:11.211 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2019-11-25T10:26:19.511 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:19.511 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2019-11-25T10:26:24.911 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:24.911 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2019-11-25T10:26:33.511 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:33.511 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2019-11-25T10:26:39.911 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:39.911 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2019-11-25T10:26:45.511 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:45.512 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2019-11-25T10:26:45.811 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:45.812 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2019-11-25T10:26:46.311 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:46.312 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2019-11-25T10:26:49.511 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:49.512 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2019-11-25T10:26:55.012 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:55.012 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2019-11-25T10:26:57.512 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:26:57.512 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2019-11-25T10:27:02.812 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:27:02.812 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2019-11-25T10:27:06.412 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:27:06.412 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2019-11-25T10:27:12.212 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:27:12.212 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2019-11-25T10:27:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:27:14.412 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2019-11-25T10:27:21.512 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:27:21.512 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent STARTED 2019-11-25T10:27:23.812 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:27:23.813 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent PASSED 2019-11-25T10:27:32.113 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:27:32.113 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2019-11-25T10:27:42.813 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:27:42.813 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2019-11-25T10:27:50.913 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:27:50.913 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI STARTED 2019-11-25T10:28:02.413 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:28:02.413 INFO:teuthology.orchestra.run.smithi135.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI PASSED 2019-11-25T10:28:09.128 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:03:22.285 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:28:09.133 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:03:22.290 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:28:09.147 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:03:22.304 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:28:09.151 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:03:22.308 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:28:09.156 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:03:22.407 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:28:09.165 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:03:22.416 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:28:09.323 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:03:22.574 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:28:09.342 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:03:22.496 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:28:09.343 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:03:22.496 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:28:10.580 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:28:10.580 INFO:teuthology.orchestra.run.smithi135.stdout:---------------------------------------------------------------------- 2019-11-25T10:28:10.580 INFO:teuthology.orchestra.run.smithi135.stdout:| Results: SUCCESS (72 tests, 72 successes, 0 failures, 0 skipped) | 2019-11-25T10:28:10.580 INFO:teuthology.orchestra.run.smithi135.stdout:---------------------------------------------------------------------- 2019-11-25T10:28:10.580 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:28:10.580 INFO:teuthology.orchestra.run.smithi135.stdout:BUILD SUCCESSFUL in 24m 3s 2019-11-25T10:28:10.581 INFO:teuthology.orchestra.run.smithi135.stdout:5 actionable tasks: 5 executed 2019-11-25T10:28:10.594 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T10:28:10.728 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:10.737+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:10.752 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:10.760+0000 7f584c7f0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:10.752 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:10.760+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:10.759 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:10.767+0000 7f584c7f0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:10.759 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:10.767+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:10.766 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:10.774+0000 7f584c7f0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:10.766 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:10.774+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:10.788 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:10.796+0000 7f584c7f0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:10.994 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.003+0000 7f584c7f0ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:28:10.995 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.003+0000 7f584c7f0ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:28:10.995 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.003+0000 7f584c7f0ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:28:10.995 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.003+0000 7f584c7f0ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:28:10.995 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.003+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.005 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.013+0000 7f584c7f0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:11.005 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.013+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.023+0000 7f584c7f0ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:28:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.023+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.027 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.035+0000 7f584c7f0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:11.027 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.035+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.036 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.044+0000 7f584c7f0ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:28:11.036 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.044+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.041 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.050+0000 7f584c7f0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:11.041 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.050+0000 7f584c7f0ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:28:11.042 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.050+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.047 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.055+0000 7f584c7f0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:11.047 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.055+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.053 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.062+0000 7f584c7f0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:11.054 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.062+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.060 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.069+0000 7f584c7f0ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:28:11.060 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.069+0000 7f584c7f0ec0 20 zonegroup default 2019-11-25T10:28:11.061 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.069+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.075+0000 7f584c7f0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.075+0000 7f584c7f0ec0 10 Cannot find current period zone using local zone 2019-11-25T10:28:11.067 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.075+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.071 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.079+0000 7f584c7f0ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:11.071 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.079+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.078 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.086+0000 7f584c7f0ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:11.078 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.087+0000 7f584c7f0ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:11.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.093+0000 7f584c7f0ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:28:11.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.093+0000 7f584c7f0ec0 20 zone default found 2019-11-25T10:28:11.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.093+0000 7f584c7f0ec0 20 started sync module instance, tier type = 2019-11-25T10:28:11.085 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.093+0000 7f584c7f0ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:28:11.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.463+0000 7f584c7f0ec0 20 add_watcher() i=0 2019-11-25T10:28:11.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.463+0000 7f584c7f0ec0 20 add_watcher() i=1 2019-11-25T10:28:11.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.463+0000 7f584c7f0ec0 20 add_watcher() i=2 2019-11-25T10:28:11.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.463+0000 7f584c7f0ec0 20 add_watcher() i=3 2019-11-25T10:28:11.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.463+0000 7f584c7f0ec0 20 add_watcher() i=4 2019-11-25T10:28:11.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.463+0000 7f584c7f0ec0 20 add_watcher() i=5 2019-11-25T10:28:11.456 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.463+0000 7f584c7f0ec0 20 add_watcher() i=6 2019-11-25T10:28:11.485 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.493+0000 7f584c7f0ec0 20 add_watcher() i=7 2019-11-25T10:28:11.485 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.493+0000 7f584c7f0ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:28:11.485 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.494+0000 7f580a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:28:11.490 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.498+0000 7f5839a1e700 0 -- 172.21.15.135:0/2894658629 >> v1:172.21.15.135:6789/0 conn(0x562a39779190 legacy=0x562a39751a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-25T10:28:11.526 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:11.534+0000 7f5839a1e700 0 -- 172.21.15.135:0/1500059444 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x562a39761030 msgr2=0x562a39786750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:28:12.923 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:12.931+0000 7f5780ff9700 20 reqs_thread_entry: start 2019-11-25T10:28:12.924 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:12.932+0000 7f577a7fc700 20 reqs_thread_entry: start 2019-11-25T10:28:12.924 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:12.932+0000 7f584c7f0ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:28:12.924 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:12.932+0000 7f5778ff9700 20 reqs_thread_entry: start 2019-11-25T10:28:12.924 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:12.932+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T10:28:12.965 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:12.974+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:12.982 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:12.990+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:12.990 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:12.998+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:13.030 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.039+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T10:28:13.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.116+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:13.132 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.140+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:13.149 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.157+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:13.149 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.157+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1103', time=2019-11-25T12:11:38.434912+0000, chain.objs.size()=7 2019-11-25T10:28:13.149 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.157+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~4FabDhYHFIKod2ibIygLeN5tp7XE1sm.1 2019-11-25T10:28:13.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.157+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~4FabDhYHFIKod2ibIygLeN5tp7XE1sm.1_1 2019-11-25T10:28:13.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.157+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~4FabDhYHFIKod2ibIygLeN5tp7XE1sm.1_2 2019-11-25T10:28:13.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.157+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~4FabDhYHFIKod2ibIygLeN5tp7XE1sm.2 2019-11-25T10:28:13.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.157+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~4FabDhYHFIKod2ibIygLeN5tp7XE1sm.2_1 2019-11-25T10:28:13.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.157+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~4FabDhYHFIKod2ibIygLeN5tp7XE1sm.2_2 2019-11-25T10:28:13.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.157+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~4FabDhYHFIKod2ibIygLeN5tp7XE1sm.3 2019-11-25T10:28:13.734 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.742+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:13.881 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.890+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T10:28:13.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.935+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:13.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.951+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:13.951 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.959+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:13.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:13.997+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T10:28:14.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.048+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:14.055 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.063+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:14.062 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.071+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:14.103 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.112+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T10:28:14.198 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.206+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:14.221 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.229+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:14.242 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.249+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:14.242 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.249+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~P1r3ZoxOlWezTQp4rsVHypjCUGindSA', time=2019-11-25T12:05:10.798999+0000, chain.objs.size()=9 2019-11-25T10:28:14.242 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.249+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.52__multipart_key1.2~P1r3ZoxOlWezTQp4rsVHypjCUGindSA.1 2019-11-25T10:28:14.242 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.249+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.52__shadow_key1.2~P1r3ZoxOlWezTQp4rsVHypjCUGindSA.1_1 2019-11-25T10:28:14.242 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.249+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.52__multipart_key1.2~P1r3ZoxOlWezTQp4rsVHypjCUGindSA.2 2019-11-25T10:28:14.243 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.249+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.52__shadow_key1.2~P1r3ZoxOlWezTQp4rsVHypjCUGindSA.2_1 2019-11-25T10:28:14.243 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.249+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.52__multipart_key1.2~P1r3ZoxOlWezTQp4rsVHypjCUGindSA.3 2019-11-25T10:28:14.243 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.249+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.52__shadow_key1.2~P1r3ZoxOlWezTQp4rsVHypjCUGindSA.3_1 2019-11-25T10:28:14.243 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.249+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.52__multipart_key1.2~P1r3ZoxOlWezTQp4rsVHypjCUGindSA.4 2019-11-25T10:28:14.243 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.250+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.52__shadow_key1.2~P1r3ZoxOlWezTQp4rsVHypjCUGindSA.4_1 2019-11-25T10:28:14.243 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.250+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.52__multipart_key1.2~P1r3ZoxOlWezTQp4rsVHypjCUGindSA.5 2019-11-25T10:28:14.742 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.750+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:14.857 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.866+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T10:28:14.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.911+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:14.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.930+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:14.931 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.939+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:14.965 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:14.973+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T10:28:15.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.189+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:15.204 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.211+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:15.230 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.236+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:28:15.230 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.236+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1159', time=2019-11-25T12:12:52.236700+0000, chain.objs.size()=9 2019-11-25T10:28:15.230 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.236+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.72__multipart_key1.2~v6a5StrpS-895XhoVGt5fbTfZrNIuy_.1 2019-11-25T10:28:15.230 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.236+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.72__shadow_key1.2~v6a5StrpS-895XhoVGt5fbTfZrNIuy_.1_1 2019-11-25T10:28:15.231 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.72__multipart_key1.2~v6a5StrpS-895XhoVGt5fbTfZrNIuy_.2 2019-11-25T10:28:15.231 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.72__shadow_key1.2~v6a5StrpS-895XhoVGt5fbTfZrNIuy_.2_1 2019-11-25T10:28:15.231 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.72__multipart_key1.2~v6a5StrpS-895XhoVGt5fbTfZrNIuy_.3 2019-11-25T10:28:15.231 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.72__shadow_key1.2~v6a5StrpS-895XhoVGt5fbTfZrNIuy_.3_1 2019-11-25T10:28:15.231 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.72__multipart_key1.2~v6a5StrpS-895XhoVGt5fbTfZrNIuy_.4 2019-11-25T10:28:15.231 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.72__shadow_key1.2~v6a5StrpS-895XhoVGt5fbTfZrNIuy_.4_1 2019-11-25T10:28:15.231 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.72__multipart_key1.2~v6a5StrpS-895XhoVGt5fbTfZrNIuy_.5 2019-11-25T10:28:15.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1904', time=2019-11-25T12:27:44.682971+0000, chain.objs.size()=9 2019-11-25T10:28:15.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.118__multipart_key1.2~9C-T0Me2i5-cbmi4ypTzkoiSSIdONBo.1 2019-11-25T10:28:15.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.118__shadow_key1.2~9C-T0Me2i5-cbmi4ypTzkoiSSIdONBo.1_1 2019-11-25T10:28:15.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.237+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.118__multipart_key1.2~9C-T0Me2i5-cbmi4ypTzkoiSSIdONBo.2 2019-11-25T10:28:15.523 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.530+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.118__shadow_key1.2~9C-T0Me2i5-cbmi4ypTzkoiSSIdONBo.2_1 2019-11-25T10:28:15.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.645+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.118__multipart_key1.2~9C-T0Me2i5-cbmi4ypTzkoiSSIdONBo.3 2019-11-25T10:28:15.753 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.760+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.118__shadow_key1.2~9C-T0Me2i5-cbmi4ypTzkoiSSIdONBo.3_1 2019-11-25T10:28:15.753 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.760+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.118__multipart_key1.2~9C-T0Me2i5-cbmi4ypTzkoiSSIdONBo.4 2019-11-25T10:28:15.753 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.760+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.118__shadow_key1.2~9C-T0Me2i5-cbmi4ypTzkoiSSIdONBo.4_1 2019-11-25T10:28:15.754 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:15.760+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.118__multipart_key1.2~9C-T0Me2i5-cbmi4ypTzkoiSSIdONBo.5 2019-11-25T10:28:16.481 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:16.488+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:16.778 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:16.785+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T10:28:16.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:16.862+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:16.882 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:16.889+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:16.901 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:16.908+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:16.958 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:16.965+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T10:28:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.053+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:17.073 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.080+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:17.083 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.090+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:17.120 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.127+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T10:28:17.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.187+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:17.230 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.237+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:17.273 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:28:17.273 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1190', time=2019-11-25T12:13:13.440381+0000, chain.objs.size()=9 2019-11-25T10:28:17.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__multipart_file.mpg.2~KzOMo89ETXGNAWAFkXYcH7SY0veSn05.1 2019-11-25T10:28:17.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__shadow_file.mpg.2~KzOMo89ETXGNAWAFkXYcH7SY0veSn05.1_1 2019-11-25T10:28:17.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__multipart_file.mpg.2~KzOMo89ETXGNAWAFkXYcH7SY0veSn05.2 2019-11-25T10:28:17.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__shadow_file.mpg.2~KzOMo89ETXGNAWAFkXYcH7SY0veSn05.2_1 2019-11-25T10:28:17.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__multipart_file.mpg.2~KzOMo89ETXGNAWAFkXYcH7SY0veSn05.3 2019-11-25T10:28:17.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__shadow_file.mpg.2~KzOMo89ETXGNAWAFkXYcH7SY0veSn05.3_1 2019-11-25T10:28:17.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__multipart_file.mpg.2~KzOMo89ETXGNAWAFkXYcH7SY0veSn05.4 2019-11-25T10:28:17.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__shadow_file.mpg.2~KzOMo89ETXGNAWAFkXYcH7SY0veSn05.4_1 2019-11-25T10:28:17.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__multipart_file.mpg.2~KzOMo89ETXGNAWAFkXYcH7SY0veSn05.5 2019-11-25T10:28:17.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1241', time=2019-11-25T12:15:38.562384+0000, chain.objs.size()=7 2019-11-25T10:28:17.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~gGtpUINgi6n3IKpa_g59iF6FmjSWyk7.1 2019-11-25T10:28:17.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~gGtpUINgi6n3IKpa_g59iF6FmjSWyk7.1_1 2019-11-25T10:28:17.275 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.252+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~gGtpUINgi6n3IKpa_g59iF6FmjSWyk7.1_2 2019-11-25T10:28:17.459 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.467+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~gGtpUINgi6n3IKpa_g59iF6FmjSWyk7.2 2019-11-25T10:28:17.586 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.595+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~gGtpUINgi6n3IKpa_g59iF6FmjSWyk7.2_1 2019-11-25T10:28:17.645 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.653+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~gGtpUINgi6n3IKpa_g59iF6FmjSWyk7.2_2 2019-11-25T10:28:17.768 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:17.776+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~gGtpUINgi6n3IKpa_g59iF6FmjSWyk7.3 2019-11-25T10:28:18.132 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.140+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:18.583 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.591+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T10:28:18.642 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.650+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:18.663 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.672+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:18.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.686+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:18.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.686+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1251', time=2019-11-25T12:16:00.868881+0000, chain.objs.size()=7 2019-11-25T10:28:18.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.686+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~koT_1hQcrEdv1BvSYTslIxn7zS7YtcT.1 2019-11-25T10:28:18.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.686+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~koT_1hQcrEdv1BvSYTslIxn7zS7YtcT.1_1 2019-11-25T10:28:18.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.686+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~koT_1hQcrEdv1BvSYTslIxn7zS7YtcT.1_2 2019-11-25T10:28:18.679 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.686+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~koT_1hQcrEdv1BvSYTslIxn7zS7YtcT.2 2019-11-25T10:28:18.679 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.686+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~koT_1hQcrEdv1BvSYTslIxn7zS7YtcT.2_1 2019-11-25T10:28:18.679 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.686+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~koT_1hQcrEdv1BvSYTslIxn7zS7YtcT.2_2 2019-11-25T10:28:18.679 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:18.686+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~koT_1hQcrEdv1BvSYTslIxn7zS7YtcT.3 2019-11-25T10:28:19.065 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.073+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:19.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.170+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T10:28:19.296 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.304+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:19.331 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.339+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:19.354 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.362+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:19.436 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.444+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T10:28:19.482 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.490+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:19.497 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.505+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:19.505 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.513+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:19.543 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.552+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T10:28:19.637 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.645+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:19.666 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.674+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:19.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:28:19.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1069', time=2019-11-25T12:09:26.453736+0000, chain.objs.size()=9 2019-11-25T10:28:19.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~Cs_WU36VPARyzDQ14poCdZIXZejPT5S.1 2019-11-25T10:28:19.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~Cs_WU36VPARyzDQ14poCdZIXZejPT5S.1_1 2019-11-25T10:28:19.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~Cs_WU36VPARyzDQ14poCdZIXZejPT5S.2 2019-11-25T10:28:19.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~Cs_WU36VPARyzDQ14poCdZIXZejPT5S.2_1 2019-11-25T10:28:19.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~Cs_WU36VPARyzDQ14poCdZIXZejPT5S.3 2019-11-25T10:28:19.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~Cs_WU36VPARyzDQ14poCdZIXZejPT5S.3_1 2019-11-25T10:28:19.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~Cs_WU36VPARyzDQ14poCdZIXZejPT5S.4 2019-11-25T10:28:19.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~Cs_WU36VPARyzDQ14poCdZIXZejPT5S.4_1 2019-11-25T10:28:19.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~Cs_WU36VPARyzDQ14poCdZIXZejPT5S.5 2019-11-25T10:28:19.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo', time=2019-11-25T12:17:28.850448+0000, chain.objs.size()=39 2019-11-25T10:28:19.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.1 2019-11-25T10:28:19.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.2 2019-11-25T10:28:19.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:19.728+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.3 2019-11-25T10:28:20.069 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.078+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.4 2019-11-25T10:28:20.070 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.078+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.5 2019-11-25T10:28:20.319 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.328+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.6 2019-11-25T10:28:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.449+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.7 2019-11-25T10:28:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.449+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.8 2019-11-25T10:28:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.449+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.9 2019-11-25T10:28:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.449+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.10 2019-11-25T10:28:20.441 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.449+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.11 2019-11-25T10:28:20.442 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.449+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.12 2019-11-25T10:28:20.442 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.449+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.13 2019-11-25T10:28:20.442 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.449+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.q7dKBh5Gosp9xBcDW5Z1w6Os-JTdzzC.14 2019-11-25T10:28:20.872 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.880+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.15 2019-11-25T10:28:20.872 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.880+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.16 2019-11-25T10:28:20.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:20.880+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.17 2019-11-25T10:28:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.222+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.6VknC_N3q5y5-3euBfCsxVK4UU6GOAh.18 2019-11-25T10:28:21.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.370+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.pq7rijD_kGDF8kzY9KekT7HBVT2gTyy.19 2019-11-25T10:28:21.367 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.370+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.Cmt5jEaNii-YtX52-1R6m8ioDJpTw3_.20 2019-11-25T10:28:21.367 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.370+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.21 2019-11-25T10:28:21.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.573+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.22 2019-11-25T10:28:21.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.573+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.23 2019-11-25T10:28:21.567 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.573+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.24 2019-11-25T10:28:21.567 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.573+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.25 2019-11-25T10:28:21.567 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.573+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.26 2019-11-25T10:28:21.618 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.625+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.27 2019-11-25T10:28:21.618 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.625+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.28 2019-11-25T10:28:21.672 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.680+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.29 2019-11-25T10:28:21.895 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.903+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.30 2019-11-25T10:28:21.895 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.903+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.31 2019-11-25T10:28:21.895 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.903+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.32 2019-11-25T10:28:21.895 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:21.903+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.33 2019-11-25T10:28:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:22.094+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.34 2019-11-25T10:28:22.336 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:22.344+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.35 2019-11-25T10:28:22.336 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:22.344+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.36 2019-11-25T10:28:22.336 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:22.344+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.37 2019-11-25T10:28:22.337 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:22.344+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.38 2019-11-25T10:28:22.337 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:22.344+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.78__multipart_key1.2~S4PiSCvHDlBEkhnsBQCojH1gycFhCOo.39 2019-11-25T10:28:23.076 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.084+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:23.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.170+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T10:28:23.242 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.250+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:23.257 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.265+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:23.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:28:23.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1077', time=2019-11-25T12:10:04.501862+0000, chain.objs.size()=9 2019-11-25T10:28:23.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~RnILaXP798osyHu6S95ZPScs5aubVjk.1 2019-11-25T10:28:23.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~RnILaXP798osyHu6S95ZPScs5aubVjk.1_1 2019-11-25T10:28:23.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~RnILaXP798osyHu6S95ZPScs5aubVjk.2 2019-11-25T10:28:23.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~RnILaXP798osyHu6S95ZPScs5aubVjk.2_1 2019-11-25T10:28:23.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~RnILaXP798osyHu6S95ZPScs5aubVjk.3 2019-11-25T10:28:23.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~RnILaXP798osyHu6S95ZPScs5aubVjk.3_1 2019-11-25T10:28:23.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~RnILaXP798osyHu6S95ZPScs5aubVjk.4 2019-11-25T10:28:23.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~RnILaXP798osyHu6S95ZPScs5aubVjk.4_1 2019-11-25T10:28:23.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~RnILaXP798osyHu6S95ZPScs5aubVjk.5 2019-11-25T10:28:23.285 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1236', time=2019-11-25T12:15:22.721895+0000, chain.objs.size()=9 2019-11-25T10:28:23.286 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~CK15C7IAnZWMYBGl6jbcAaOniwvv1sL.1 2019-11-25T10:28:23.286 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~CK15C7IAnZWMYBGl6jbcAaOniwvv1sL.1_1 2019-11-25T10:28:23.286 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:23.292+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~CK15C7IAnZWMYBGl6jbcAaOniwvv1sL.2 2019-11-25T10:28:24.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:24.136+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~CK15C7IAnZWMYBGl6jbcAaOniwvv1sL.2_1 2019-11-25T10:28:24.169 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:24.177+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~CK15C7IAnZWMYBGl6jbcAaOniwvv1sL.3 2019-11-25T10:28:24.169 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:24.177+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~CK15C7IAnZWMYBGl6jbcAaOniwvv1sL.3_1 2019-11-25T10:28:24.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:24.221+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~CK15C7IAnZWMYBGl6jbcAaOniwvv1sL.4 2019-11-25T10:28:24.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:24.221+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~CK15C7IAnZWMYBGl6jbcAaOniwvv1sL.4_1 2019-11-25T10:28:24.213 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:24.221+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~CK15C7IAnZWMYBGl6jbcAaOniwvv1sL.5 2019-11-25T10:28:24.865 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:24.873+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:24.932 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:24.940+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T10:28:24.978 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:24.986+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:25.000 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.008+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:25.019 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.027+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:25.019 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.027+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1246', time=2019-11-25T12:15:56.418623+0000, chain.objs.size()=7 2019-11-25T10:28:25.019 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.027+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~-1eAbqnTOWNnrnIb1YYmdJsXxZ1NdFm.1 2019-11-25T10:28:25.020 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.027+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~-1eAbqnTOWNnrnIb1YYmdJsXxZ1NdFm.1_1 2019-11-25T10:28:25.020 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.027+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~-1eAbqnTOWNnrnIb1YYmdJsXxZ1NdFm.1_2 2019-11-25T10:28:25.020 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.027+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~-1eAbqnTOWNnrnIb1YYmdJsXxZ1NdFm.2 2019-11-25T10:28:25.020 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.027+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~-1eAbqnTOWNnrnIb1YYmdJsXxZ1NdFm.2_1 2019-11-25T10:28:25.020 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.027+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~-1eAbqnTOWNnrnIb1YYmdJsXxZ1NdFm.2_2 2019-11-25T10:28:25.020 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.027+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~-1eAbqnTOWNnrnIb1YYmdJsXxZ1NdFm.3 2019-11-25T10:28:25.665 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.673+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:25.741 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.748+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T10:28:25.786 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.794+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.824+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:25.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.841+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:25.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.899+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T10:28:25.940 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.948+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:25.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.975+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:25.981 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:25.989+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:26.115 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.123+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T10:28:26.421 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.429+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:26.718 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.726+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:26.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.753+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-25T10:28:26.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.753+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1222', time=2019-11-25T12:14:45.830918+0000, chain.objs.size()=9 2019-11-25T10:28:26.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~0QBhHKjqiDEFJsFhngPVsTH4N5oG1oh.1 2019-11-25T10:28:26.746 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~0QBhHKjqiDEFJsFhngPVsTH4N5oG1oh.1_1 2019-11-25T10:28:26.747 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~0QBhHKjqiDEFJsFhngPVsTH4N5oG1oh.2 2019-11-25T10:28:26.747 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~0QBhHKjqiDEFJsFhngPVsTH4N5oG1oh.2_1 2019-11-25T10:28:26.747 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~0QBhHKjqiDEFJsFhngPVsTH4N5oG1oh.3 2019-11-25T10:28:26.747 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~0QBhHKjqiDEFJsFhngPVsTH4N5oG1oh.3_1 2019-11-25T10:28:26.747 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~0QBhHKjqiDEFJsFhngPVsTH4N5oG1oh.4 2019-11-25T10:28:26.747 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~0QBhHKjqiDEFJsFhngPVsTH4N5oG1oh.4_1 2019-11-25T10:28:26.747 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~0QBhHKjqiDEFJsFhngPVsTH4N5oG1oh.5 2019-11-25T10:28:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1281', time=2019-11-25T12:17:04.317401+0000, chain.objs.size()=9 2019-11-25T10:28:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.77__multipart_key1.2~emH_Zai9Fx6PzfanBvNgaUCl16glhk2.1 2019-11-25T10:28:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.77__shadow_key1.2~emH_Zai9Fx6PzfanBvNgaUCl16glhk2.1_1 2019-11-25T10:28:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:26.754+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.77__multipart_key1.2~emH_Zai9Fx6PzfanBvNgaUCl16glhk2.2 2019-11-25T10:28:27.042 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.050+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.77__shadow_key1.2~emH_Zai9Fx6PzfanBvNgaUCl16glhk2.2_1 2019-11-25T10:28:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.332+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.77__multipart_key1.2~emH_Zai9Fx6PzfanBvNgaUCl16glhk2.3 2019-11-25T10:28:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.332+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.77__shadow_key1.2~emH_Zai9Fx6PzfanBvNgaUCl16glhk2.3_1 2019-11-25T10:28:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.332+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.77__multipart_key1.2~emH_Zai9Fx6PzfanBvNgaUCl16glhk2.4 2019-11-25T10:28:27.356 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.364+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.77__shadow_key1.2~emH_Zai9Fx6PzfanBvNgaUCl16glhk2.4_1 2019-11-25T10:28:27.356 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.364+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.77__multipart_key1.2~emH_Zai9Fx6PzfanBvNgaUCl16glhk2.5 2019-11-25T10:28:27.567 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.575+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1920', time=2019-11-25T12:28:04.338490+0000, chain.objs.size()=9 2019-11-25T10:28:27.568 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.575+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.119__multipart_key1/data/file.mpg.2~_IPwMpf4UrT5V-l6S79VS_NZM3euVG8.1 2019-11-25T10:28:27.568 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.575+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.119__shadow_key1/data/file.mpg.2~_IPwMpf4UrT5V-l6S79VS_NZM3euVG8.1_1 2019-11-25T10:28:27.568 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.575+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.119__multipart_key1/data/file.mpg.2~_IPwMpf4UrT5V-l6S79VS_NZM3euVG8.2 2019-11-25T10:28:27.568 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.575+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.119__shadow_key1/data/file.mpg.2~_IPwMpf4UrT5V-l6S79VS_NZM3euVG8.2_1 2019-11-25T10:28:27.568 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.575+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.119__multipart_key1/data/file.mpg.2~_IPwMpf4UrT5V-l6S79VS_NZM3euVG8.3 2019-11-25T10:28:27.569 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:27.575+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.119__shadow_key1/data/file.mpg.2~_IPwMpf4UrT5V-l6S79VS_NZM3euVG8.3_1 2019-11-25T10:28:28.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:28.191+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.119__multipart_key1/data/file.mpg.2~_IPwMpf4UrT5V-l6S79VS_NZM3euVG8.4 2019-11-25T10:28:28.183 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:28.191+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.119__shadow_key1/data/file.mpg.2~_IPwMpf4UrT5V-l6S79VS_NZM3euVG8.4_1 2019-11-25T10:28:28.184 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:28.191+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.119__multipart_key1/data/file.mpg.2~_IPwMpf4UrT5V-l6S79VS_NZM3euVG8.5 2019-11-25T10:28:28.933 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:28.941+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:29.151 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.159+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T10:28:29.214 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.222+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:29.253 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.261+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:29.270 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.278+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:29.313 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.321+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T10:28:29.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.375+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:29.386 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.394+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:29.402 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:29.402 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1085', time=2019-11-25T12:10:33.006878+0000, chain.objs.size()=9 2019-11-25T10:28:29.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~toKz8SOAm7h_7B-XyhATfWQQWtEsliN.1 2019-11-25T10:28:29.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~toKz8SOAm7h_7B-XyhATfWQQWtEsliN.1_1 2019-11-25T10:28:29.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~toKz8SOAm7h_7B-XyhATfWQQWtEsliN.2 2019-11-25T10:28:29.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~toKz8SOAm7h_7B-XyhATfWQQWtEsliN.2_1 2019-11-25T10:28:29.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~toKz8SOAm7h_7B-XyhATfWQQWtEsliN.3 2019-11-25T10:28:29.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~toKz8SOAm7h_7B-XyhATfWQQWtEsliN.3_1 2019-11-25T10:28:29.404 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~toKz8SOAm7h_7B-XyhATfWQQWtEsliN.4 2019-11-25T10:28:29.404 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~toKz8SOAm7h_7B-XyhATfWQQWtEsliN.4_1 2019-11-25T10:28:29.404 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.410+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~toKz8SOAm7h_7B-XyhATfWQQWtEsliN.5 2019-11-25T10:28:29.924 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:29.932+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:29.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.007+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T10:28:30.036 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.044+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:30.052 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.060+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:30.063 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.071+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:30.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.071+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1097', time=2019-11-25T12:11:28.456696+0000, chain.objs.size()=7 2019-11-25T10:28:30.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.071+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~Ji5xRD9muwkEV7ji9nfGUehSewfhj2H.1 2019-11-25T10:28:30.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.071+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~Ji5xRD9muwkEV7ji9nfGUehSewfhj2H.1_1 2019-11-25T10:28:30.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.071+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~Ji5xRD9muwkEV7ji9nfGUehSewfhj2H.1_2 2019-11-25T10:28:30.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.071+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~Ji5xRD9muwkEV7ji9nfGUehSewfhj2H.2 2019-11-25T10:28:30.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.071+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~Ji5xRD9muwkEV7ji9nfGUehSewfhj2H.2_1 2019-11-25T10:28:30.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.071+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~Ji5xRD9muwkEV7ji9nfGUehSewfhj2H.2_2 2019-11-25T10:28:30.065 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.071+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~Ji5xRD9muwkEV7ji9nfGUehSewfhj2H.3 2019-11-25T10:28:30.880 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:30.888+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:31.067 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.075+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T10:28:31.136 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.144+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:31.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.171+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:31.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-11-25T10:28:31.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1048', time=2019-11-25T12:07:24.166249+0000, chain.objs.size()=9 2019-11-25T10:28:31.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__multipart_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.1 2019-11-25T10:28:31.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__shadow_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.1_1 2019-11-25T10:28:31.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__multipart_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.2 2019-11-25T10:28:31.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__shadow_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.2_1 2019-11-25T10:28:31.190 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__multipart_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.3 2019-11-25T10:28:31.191 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__shadow_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.3_1 2019-11-25T10:28:31.191 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__multipart_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.4 2019-11-25T10:28:31.191 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__shadow_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.4_1 2019-11-25T10:28:31.191 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__multipart_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.5 2019-11-25T10:28:31.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1266', time=2019-11-25T12:16:39.300519+0000, chain.objs.size()=9 2019-11-25T10:28:31.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.76__multipart_key1.2~04AESizjCHDRgNUgjNFVQSkyWmkpu5h.1 2019-11-25T10:28:31.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.76__shadow_key1.2~04AESizjCHDRgNUgjNFVQSkyWmkpu5h.1_1 2019-11-25T10:28:31.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.197+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.76__multipart_key1.2~04AESizjCHDRgNUgjNFVQSkyWmkpu5h.2 2019-11-25T10:28:31.524 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.532+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.76__shadow_key1.2~04AESizjCHDRgNUgjNFVQSkyWmkpu5h.2_1 2019-11-25T10:28:31.525 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.532+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.76__multipart_key1.2~04AESizjCHDRgNUgjNFVQSkyWmkpu5h.3 2019-11-25T10:28:31.586 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.594+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.76__shadow_key1.2~04AESizjCHDRgNUgjNFVQSkyWmkpu5h.3_1 2019-11-25T10:28:31.586 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.594+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.76__multipart_key1.2~04AESizjCHDRgNUgjNFVQSkyWmkpu5h.4 2019-11-25T10:28:31.586 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.594+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.76__shadow_key1.2~04AESizjCHDRgNUgjNFVQSkyWmkpu5h.4_1 2019-11-25T10:28:31.586 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:31.594+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.76__multipart_key1.2~04AESizjCHDRgNUgjNFVQSkyWmkpu5h.5 2019-11-25T10:28:32.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.171+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:32.247 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.255+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T10:28:32.418 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.426+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:32.437 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.445+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:32.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-11-25T10:28:32.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.977', time=2019-11-25T12:05:53.491285+0000, chain.objs.size()=2 2019-11-25T10:28:32.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.56__shadow_.n_txyDQOH2-Mi02neOBO8I-ap6Y5YWJ_1 2019-11-25T10:28:32.452 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.56__shadow_.n_txyDQOH2-Mi02neOBO8I-ap6Y5YWJ_2 2019-11-25T10:28:32.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1061', time=2019-11-25T12:11:32.025826+0000, chain.objs.size()=5 2019-11-25T10:28:32.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.66__shadow_.cVvCnIxT5gHk9N8dTMmPiER7IbYyv_p_1 2019-11-25T10:28:32.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.66__shadow_.cVvCnIxT5gHk9N8dTMmPiER7IbYyv_p_2 2019-11-25T10:28:32.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.66__shadow_.cVvCnIxT5gHk9N8dTMmPiER7IbYyv_p_3 2019-11-25T10:28:32.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.66__shadow_.cVvCnIxT5gHk9N8dTMmPiER7IbYyv_p_4 2019-11-25T10:28:32.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.66__shadow_.cVvCnIxT5gHk9N8dTMmPiER7IbYyv_p_5 2019-11-25T10:28:32.453 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~8OUl8o3EDeCR8kG_d-6_zfnNkCA-cCf', time=2019-11-25T12:13:55.390557+0000, chain.objs.size()=9 2019-11-25T10:28:32.454 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.74__multipart_key1.2~8OUl8o3EDeCR8kG_d-6_zfnNkCA-cCf.7 2019-11-25T10:28:32.454 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.74__shadow_key1.2~8OUl8o3EDeCR8kG_d-6_zfnNkCA-cCf.7_1 2019-11-25T10:28:32.454 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.74__multipart_key1.2~8OUl8o3EDeCR8kG_d-6_zfnNkCA-cCf.8 2019-11-25T10:28:32.454 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.74__shadow_key1.2~8OUl8o3EDeCR8kG_d-6_zfnNkCA-cCf.8_1 2019-11-25T10:28:32.454 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.460+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.74__multipart_key1.2~8OUl8o3EDeCR8kG_d-6_zfnNkCA-cCf.9 2019-11-25T10:28:32.895 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.903+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.74__shadow_key1.2~8OUl8o3EDeCR8kG_d-6_zfnNkCA-cCf.9_1 2019-11-25T10:28:32.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.951+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.74__multipart_key1.2~8OUl8o3EDeCR8kG_d-6_zfnNkCA-cCf.10 2019-11-25T10:28:32.944 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.951+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.74__shadow_key1.2~8OUl8o3EDeCR8kG_d-6_zfnNkCA-cCf.10_1 2019-11-25T10:28:32.944 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:32.951+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.74__multipart_key1.2~8OUl8o3EDeCR8kG_d-6_zfnNkCA-cCf.11 2019-11-25T10:28:33.486 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:33.494+0000 7f580a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:28:33.523 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:33.531+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:33.924 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:33.932+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T10:28:33.982 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:33.990+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:34.010 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.018+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:34.043 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:34.043 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1229', time=2019-11-25T12:15:08.590894+0000, chain.objs.size()=9 2019-11-25T10:28:34.043 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~tucI7j2FTIXgic8GTrviP2iO8LPcjhg.1 2019-11-25T10:28:34.043 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~tucI7j2FTIXgic8GTrviP2iO8LPcjhg.1_1 2019-11-25T10:28:34.044 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~tucI7j2FTIXgic8GTrviP2iO8LPcjhg.2 2019-11-25T10:28:34.044 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~tucI7j2FTIXgic8GTrviP2iO8LPcjhg.2_1 2019-11-25T10:28:34.044 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~tucI7j2FTIXgic8GTrviP2iO8LPcjhg.3 2019-11-25T10:28:34.044 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~tucI7j2FTIXgic8GTrviP2iO8LPcjhg.3_1 2019-11-25T10:28:34.044 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~tucI7j2FTIXgic8GTrviP2iO8LPcjhg.4 2019-11-25T10:28:34.044 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__shadow_key1.2~tucI7j2FTIXgic8GTrviP2iO8LPcjhg.4_1 2019-11-25T10:28:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.050+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.75__multipart_key1.2~tucI7j2FTIXgic8GTrviP2iO8LPcjhg.5 2019-11-25T10:28:34.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:34.646+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:35.027 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.035+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T10:28:35.077 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.085+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:35.092 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.100+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:35.107 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:35.107 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1191', time=2019-11-25T12:13:16.332582+0000, chain.objs.size()=9 2019-11-25T10:28:35.107 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__multipart_file2.mpg.2~pL25XXnbuoDqSKqDfMtubpxNdZcsbfU.1 2019-11-25T10:28:35.107 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__shadow_file2.mpg.2~pL25XXnbuoDqSKqDfMtubpxNdZcsbfU.1_1 2019-11-25T10:28:35.107 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__multipart_file2.mpg.2~pL25XXnbuoDqSKqDfMtubpxNdZcsbfU.2 2019-11-25T10:28:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__shadow_file2.mpg.2~pL25XXnbuoDqSKqDfMtubpxNdZcsbfU.2_1 2019-11-25T10:28:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__multipart_file2.mpg.2~pL25XXnbuoDqSKqDfMtubpxNdZcsbfU.3 2019-11-25T10:28:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__shadow_file2.mpg.2~pL25XXnbuoDqSKqDfMtubpxNdZcsbfU.3_1 2019-11-25T10:28:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__multipart_file2.mpg.2~pL25XXnbuoDqSKqDfMtubpxNdZcsbfU.4 2019-11-25T10:28:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__shadow_file2.mpg.2~pL25XXnbuoDqSKqDfMtubpxNdZcsbfU.4_1 2019-11-25T10:28:35.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.114+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.73__multipart_file2.mpg.2~pL25XXnbuoDqSKqDfMtubpxNdZcsbfU.5 2019-11-25T10:28:35.631 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.638+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:35.922 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:35.930+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T10:28:35.992 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.000+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:36.018 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.026+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:36.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.046+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:36.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.046+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1091', time=2019-11-25T12:10:59.603731+0000, chain.objs.size()=7 2019-11-25T10:28:36.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.046+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~3F-eF-Nf64n8Ogk8gEDLdXwZKDgBhMw.1 2019-11-25T10:28:36.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.046+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~3F-eF-Nf64n8Ogk8gEDLdXwZKDgBhMw.1_1 2019-11-25T10:28:36.039 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.046+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~3F-eF-Nf64n8Ogk8gEDLdXwZKDgBhMw.1_2 2019-11-25T10:28:36.040 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.046+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~3F-eF-Nf64n8Ogk8gEDLdXwZKDgBhMw.2 2019-11-25T10:28:36.040 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.046+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~3F-eF-Nf64n8Ogk8gEDLdXwZKDgBhMw.2_1 2019-11-25T10:28:36.040 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.046+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__shadow_key1.2~3F-eF-Nf64n8Ogk8gEDLdXwZKDgBhMw.2_2 2019-11-25T10:28:36.040 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.046+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.67__multipart_key1.2~3F-eF-Nf64n8Ogk8gEDLdXwZKDgBhMw.3 2019-11-25T10:28:36.471 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.479+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:36.567 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.575+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T10:28:36.647 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.655+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:36.666 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.674+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:36.680 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.687+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:36.680 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.687+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1046', time=2019-11-25T12:07:30.474133+0000, chain.objs.size()=9 2019-11-25T10:28:36.680 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.687+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__multipart_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.1 2019-11-25T10:28:36.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.687+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__shadow_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.1_1 2019-11-25T10:28:36.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.687+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__multipart_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.2 2019-11-25T10:28:36.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.687+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__shadow_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.2_1 2019-11-25T10:28:36.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.687+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__multipart_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.3 2019-11-25T10:28:36.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.687+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__shadow_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.3_1 2019-11-25T10:28:36.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.688+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__multipart_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.4 2019-11-25T10:28:36.681 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.688+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__shadow_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.4_1 2019-11-25T10:28:36.682 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:36.688+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.64__multipart_key1.2~vnS15tjPPpcInEwGfHSisXRakEzcdNK.5 2019-11-25T10:28:37.260 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:37.268+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:37.630 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:37.638+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T10:28:37.716 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:37.724+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:37.750 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:37.758+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:37.771 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:37.779+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:37.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:37.839+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T10:28:37.900 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:37.908+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:37.925 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:37.933+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:37.938 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:37.946+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:37.978 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:37.985+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T10:28:38.049 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.057+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:38.072 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.080+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:38.083 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.090+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:38.114 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.122+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T10:28:38.161 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.169+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:38.179 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.187+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:38.194 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-11-25T10:28:38.194 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 20 garbage collection: RGWGC::process iterating over entry tag='b9020152-a9a6-4198-abf1-1fb1ecbb8573.4509.1140', time=2019-11-25T12:12:22.845612+0000, chain.objs.size()=9 2019-11-25T10:28:38.194 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.71__multipart_key1.2~WtL2ckVnYB4WFGwHJW2diBZmMxI4ghe.1 2019-11-25T10:28:38.194 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.71__shadow_key1.2~WtL2ckVnYB4WFGwHJW2diBZmMxI4ghe.1_1 2019-11-25T10:28:38.194 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.71__multipart_key1.2~WtL2ckVnYB4WFGwHJW2diBZmMxI4ghe.2 2019-11-25T10:28:38.194 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.71__shadow_key1.2~WtL2ckVnYB4WFGwHJW2diBZmMxI4ghe.2_1 2019-11-25T10:28:38.195 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.71__multipart_key1.2~WtL2ckVnYB4WFGwHJW2diBZmMxI4ghe.3 2019-11-25T10:28:38.195 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.71__shadow_key1.2~WtL2ckVnYB4WFGwHJW2diBZmMxI4ghe.3_1 2019-11-25T10:28:38.195 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.71__multipart_key1.2~WtL2ckVnYB4WFGwHJW2diBZmMxI4ghe.4 2019-11-25T10:28:38.195 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.71__shadow_key1.2~WtL2ckVnYB4WFGwHJW2diBZmMxI4ghe.4_1 2019-11-25T10:28:38.195 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.201+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.71__multipart_key1.2~WtL2ckVnYB4WFGwHJW2diBZmMxI4ghe.5 2019-11-25T10:28:38.703 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:38.710+0000 7f584c7f0ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-11-25T10:28:39.052 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.059+0000 7f584c7f0ec0 20 remove_watcher() i=0 2019-11-25T10:28:39.052 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.059+0000 7f584c7f0ec0 2 removed watcher, disabling cache 2019-11-25T10:28:39.080 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.088+0000 7f584c7f0ec0 20 remove_watcher() i=1 2019-11-25T10:28:39.109 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.117+0000 7f584c7f0ec0 20 remove_watcher() i=2 2019-11-25T10:28:39.140 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.148+0000 7f584c7f0ec0 20 remove_watcher() i=3 2019-11-25T10:28:39.177 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.183+0000 7f584c7f0ec0 20 remove_watcher() i=4 2019-11-25T10:28:39.206 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.213+0000 7f584c7f0ec0 20 remove_watcher() i=5 2019-11-25T10:28:39.242 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.248+0000 7f584c7f0ec0 20 remove_watcher() i=6 2019-11-25T10:28:39.282 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.289+0000 7f584c7f0ec0 20 remove_watcher() i=7 2019-11-25T10:28:39.290 INFO:teuthology.orchestra.run.smithi135:> radosgw-admin gc process --include-all 2019-11-25T10:28:39.416 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.423+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.442 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.449+0000 7f76bba59ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:39.442 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.449+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.459 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.466+0000 7f76bba59ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:39.459 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.466+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.465 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.472+0000 7f76bba59ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:39.465 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.472+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.489 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.495+0000 7f76bba59ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:39.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.706+0000 7f76bba59ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:28:39.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.706+0000 7f76bba59ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:28:39.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.706+0000 7f76bba59ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:28:39.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.706+0000 7f76bba59ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:28:39.700 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.706+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.712 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.718+0000 7f76bba59ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:39.712 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.718+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.724 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.730+0000 7f76bba59ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:28:39.724 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.730+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.738 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.745+0000 7f76bba59ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:39.738 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.745+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.749 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.756+0000 7f76bba59ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:28:39.749 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.756+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.756 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.763+0000 7f76bba59ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:39.756 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.763+0000 7f76bba59ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:28:39.756 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.763+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.768+0000 7f76bba59ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:39.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.768+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.773 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.780+0000 7f76bba59ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:39.773 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.780+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.790+0000 7f76bba59ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:28:39.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.790+0000 7f76bba59ec0 20 zonegroup default 2019-11-25T10:28:39.784 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.790+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.789 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.796+0000 7f76bba59ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:39.789 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.796+0000 7f76bba59ec0 10 Cannot find current period zone using local zone 2019-11-25T10:28:39.789 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.796+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.793 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.800+0000 7f76bba59ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:39.793 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.800+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.804 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.811+0000 7f76bba59ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:39.804 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.811+0000 7f76bba59ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:39.821 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.828+0000 7f76bba59ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:28:39.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.828+0000 7f76bba59ec0 20 zone default found 2019-11-25T10:28:39.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.828+0000 7f76bba59ec0 20 started sync module instance, tier type = 2019-11-25T10:28:39.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:39.828+0000 7f76bba59ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:28:40.179 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.186+0000 7f76bba59ec0 20 add_watcher() i=0 2019-11-25T10:28:40.179 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.186+0000 7f76bba59ec0 20 add_watcher() i=1 2019-11-25T10:28:40.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.186+0000 7f76bba59ec0 20 add_watcher() i=2 2019-11-25T10:28:40.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.186+0000 7f76bba59ec0 20 add_watcher() i=3 2019-11-25T10:28:40.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.186+0000 7f76bba59ec0 20 add_watcher() i=4 2019-11-25T10:28:40.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.186+0000 7f76bba59ec0 20 add_watcher() i=5 2019-11-25T10:28:40.180 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.186+0000 7f76bba59ec0 20 add_watcher() i=6 2019-11-25T10:28:40.223 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.230+0000 7f76bba59ec0 20 add_watcher() i=7 2019-11-25T10:28:40.224 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.230+0000 7f76bba59ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:28:40.224 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.230+0000 7f76797e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:28:40.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.239+0000 7f76a8c87700 0 -- 172.21.15.135:0/1966653910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5649f0b50b30 msgr2=0x5649f0b4fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T10:28:40.435 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.442+0000 7f76a8c87700 0 --2- 172.21.15.135:0/1966653910 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x5649f0b50b30 0x5649f0b4fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-25T10:28:40.501 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:40.507+0000 7f76a9488700 0 -- 172.21.15.135:0/96327344 >> [v2:172.21.15.174:6800/8260,v1:172.21.15.174:6801/8260] conn(0x7f75ec017570 msgr2=0x7f75ec019a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:28:42.074 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.082+0000 7f75eb7fe700 20 reqs_thread_entry: start 2019-11-25T10:28:42.075 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.082+0000 7f75e97fa700 20 reqs_thread_entry: start 2019-11-25T10:28:42.075 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.082+0000 7f76bba59ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:28:42.075 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.082+0000 7f75d77fe700 20 reqs_thread_entry: start 2019-11-25T10:28:42.075 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.082+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-11-25T10:28:42.129 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.137+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.157+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:42.161 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.168+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.200 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.207+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-11-25T10:28:42.260 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.268+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.280 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.288+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:42.292 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.299+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.332 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.339+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-11-25T10:28:42.375 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.383+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.393 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.400+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:42.401 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.409+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.445 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.452+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-11-25T10:28:42.500 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.508+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.517 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.525+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:42.529 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.537+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.596+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-11-25T10:28:42.679 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.687+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.727 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.735+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:42.740 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.748+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.777 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.785+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-11-25T10:28:42.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.827+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.836 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.844+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:42.851 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.859+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.883 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.891+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-11-25T10:28:42.933 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.941+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:42.962 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.969+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:42.975 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:42.983+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.010 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.018+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-11-25T10:28:43.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.072+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.081 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.089+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:43.090 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.098+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.136+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-11-25T10:28:43.174 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.182+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.194 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.201+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:43.203 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.211+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.237 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.245+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-11-25T10:28:43.281 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.289+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.315 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.323+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:43.327 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.335+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.376 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.384+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-11-25T10:28:43.440 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.447+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.468 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.475+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:43.478 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.486+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.522 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.530+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-11-25T10:28:43.580 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.588+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.608 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.615+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:43.618 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.625+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.654+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-11-25T10:28:43.685 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.692+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.704 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.712+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:43.716 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.724+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.765 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.773+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-11-25T10:28:43.811 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.819+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.830 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.838+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:43.839 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.847+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.868 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.876+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-11-25T10:28:43.913 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.920+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:43.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.945+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:43.948 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:43.956+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.010 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.018+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-11-25T10:28:44.075 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.082+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.102+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:44.105 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.113+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.154+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-11-25T10:28:44.209 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.217+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.228 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.236+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:44.238 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.246+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.290+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-11-25T10:28:44.347 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.355+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.366 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.374+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:44.378 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.385+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.438 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.446+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-11-25T10:28:44.485 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.493+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.501 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.509+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:44.510 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.518+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.558 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.566+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-11-25T10:28:44.623 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.630+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.650 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.658+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:44.664 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.672+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.709 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.716+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-11-25T10:28:44.769 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.776+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.811 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.819+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:44.822 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.829+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.858 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.866+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-11-25T10:28:44.902 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.910+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.928+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:44.930 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.938+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:44.966 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:44.973+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-11-25T10:28:45.026 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.033+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.045 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.053+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:45.054 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.062+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.088 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.096+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-11-25T10:28:45.133 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.141+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.150 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.158+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:45.159 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.166+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.199 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.206+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-11-25T10:28:45.273 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.281+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.307+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:45.314 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.322+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.367+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-11-25T10:28:45.433 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.440+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.457 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.465+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:45.469 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.477+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.526+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-11-25T10:28:45.635 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.643+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.671 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.679+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:45.688 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.695+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.734 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.741+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-11-25T10:28:45.825 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.832+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.849 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.857+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:45.858 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.865+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:45.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:45.936+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-11-25T10:28:46.008 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.015+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:46.041 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.049+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:46.057 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.064+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:46.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.115+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-11-25T10:28:46.169 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.176+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:46.191 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.199+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:46.203 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.210+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:46.255 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.262+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-11-25T10:28:46.343 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.351+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:46.372 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.380+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:46.391 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.399+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:46.448 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.456+0000 7f76bba59ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-11-25T10:28:46.513 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.521+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:46.537 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.544+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-11-25T10:28:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.554+0000 7f76bba59ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-11-25T10:28:46.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.660+0000 7f76bba59ec0 20 remove_watcher() i=0 2019-11-25T10:28:46.652 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.660+0000 7f76bba59ec0 2 removed watcher, disabling cache 2019-11-25T10:28:46.714 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.721+0000 7f76bba59ec0 20 remove_watcher() i=1 2019-11-25T10:28:46.765 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.773+0000 7f76bba59ec0 20 remove_watcher() i=2 2019-11-25T10:28:46.839 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.845+0000 7f76bba59ec0 20 remove_watcher() i=3 2019-11-25T10:28:46.893 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.900+0000 7f76bba59ec0 20 remove_watcher() i=4 2019-11-25T10:28:46.956 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:46.964+0000 7f76bba59ec0 20 remove_watcher() i=5 2019-11-25T10:28:47.003 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:47.010+0000 7f76bba59ec0 20 remove_watcher() i=6 2019-11-25T10:28:47.055 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:47.062+0000 7f76bba59ec0 20 remove_watcher() i=7 2019-11-25T10:28:47.062 INFO:teuthology.run_tasks:Running task s3tests... 2019-11-25T10:28:47.134 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'slow_backend': True}} 2019-11-25T10:28:47.134 INFO:tasks.s3tests:Downloading s3-tests... 2019-11-25T10:28:47.135 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2019-11-25T10:28:47.135 INFO:teuthology.orchestra.run.smithi135:> git clone -b ceph-master git://git.ceph.com/git/s3-tests.git /home/ubuntu/cephtest/s3-tests 2019-11-25T10:28:47.269 INFO:teuthology.orchestra.run.smithi135.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests'... 2019-11-25T10:28:47.783 INFO:tasks.s3tests:Creating rgw users... 2019-11-25T10:28:47.784 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2019-11-25T10:28:47.784 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --access-key HFQOFSLPWPXHSNLQOFSG --secret 7/E//j/3ShGYLUSI0kLl9rjA+ct3WbuDrkaXJveJUnSd0bdk/azw7w== --email bar.client.0+test@test.test --cluster ceph 2019-11-25T10:28:47.917 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:47.924+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:47.953 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:47.960+0000 7fb1796c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:47.953 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:47.960+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:47.964 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:47.972+0000 7fb1796c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:47.965 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:47.972+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:47.975 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:47.983+0000 7fb1796c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:47.975 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:47.983+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.002 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.010+0000 7fb1796c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:48.228 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.235+0000 7fb1796c3ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:28:48.228 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.235+0000 7fb1796c3ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:28:48.228 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.235+0000 7fb1796c3ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:28:48.228 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.235+0000 7fb1796c3ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:28:48.229 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.235+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.249+0000 7fb1796c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:48.242 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.249+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.252 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.260+0000 7fb1796c3ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:28:48.253 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.260+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.261 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.268+0000 7fb1796c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:48.261 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.269+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.276 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.283+0000 7fb1796c3ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:28:48.276 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.283+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.282 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.289+0000 7fb1796c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:48.282 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.289+0000 7fb1796c3ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:28:48.282 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.290+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.288 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.295+0000 7fb1796c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:48.288 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.295+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.308+0000 7fb1796c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:48.300 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.308+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.312 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.320+0000 7fb1796c3ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:28:48.312 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.320+0000 7fb1796c3ec0 20 zonegroup default 2019-11-25T10:28:48.312 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.320+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.318 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.325+0000 7fb1796c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:48.318 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.325+0000 7fb1796c3ec0 10 Cannot find current period zone using local zone 2019-11-25T10:28:48.318 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.325+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.324 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.331+0000 7fb1796c3ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:48.324 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.331+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.343+0000 7fb1796c3ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:48.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.343+0000 7fb1796c3ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:48.344 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.352+0000 7fb1796c3ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:28:48.344 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.352+0000 7fb1796c3ec0 20 zone default found 2019-11-25T10:28:48.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.352+0000 7fb1796c3ec0 20 started sync module instance, tier type = 2019-11-25T10:28:48.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.352+0000 7fb1796c3ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:28:48.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.727+0000 7fb1796c3ec0 20 add_watcher() i=0 2019-11-25T10:28:48.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.727+0000 7fb1796c3ec0 20 add_watcher() i=1 2019-11-25T10:28:48.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.727+0000 7fb1796c3ec0 20 add_watcher() i=2 2019-11-25T10:28:48.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.727+0000 7fb1796c3ec0 20 add_watcher() i=3 2019-11-25T10:28:48.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.727+0000 7fb1796c3ec0 20 add_watcher() i=4 2019-11-25T10:28:48.721 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.727+0000 7fb1796c3ec0 20 add_watcher() i=5 2019-11-25T10:28:48.722 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.729+0000 7fb1796c3ec0 20 add_watcher() i=6 2019-11-25T10:28:48.751 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.759+0000 7fb1796c3ec0 20 add_watcher() i=7 2019-11-25T10:28:48.751 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.759+0000 7fb1796c3ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:28:48.751 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.759+0000 7fb1377de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:28:48.760 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.768+0000 7fb15ffff700 0 -- 172.21.15.135:0/1856059340 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x558134c3cc70 msgr2=0x558134c3f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T10:28:48.963 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:48.970+0000 7fb15ffff700 0 --2- 172.21.15.135:0/1856059340 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x558134c3cc70 0x558134c3f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-25T10:28:49.010 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:49.017+0000 7fb15ffff700 0 -- 172.21.15.135:0/745144104 >> v2:172.21.15.174:3300/0 conn(0x558134c452e0 msgr2=0x558134c477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:28:50.809 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.816+0000 7fb0a5ffb700 20 reqs_thread_entry: start 2019-11-25T10:28:50.809 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.816+0000 7fb09f7fe700 20 reqs_thread_entry: start 2019-11-25T10:28:50.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.817+0000 7fb1796c3ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:28:50.810 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.817+0000 7fb09dffb700 20 reqs_thread_entry: start 2019-11-25T10:28:50.811 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.817+0000 7fb1796c3ec0 20 get_system_obj_state: rctx=0x7ffd53076c68 obj=default.rgw.meta:users.uid:bar.client.0 state=0x558134cae3b0 s->prefetch_data=0 2019-11-25T10:28:50.811 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.817+0000 7fb1796c3ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-25T10:28:50.819 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.827+0000 7fb1796c3ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-25T10:28:50.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.827+0000 7fb1796c3ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T10:28:50.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.827+0000 7fb1796c3ec0 20 get_system_obj_state: rctx=0x7ffd53076c78 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x558134cb0140 s->prefetch_data=0 2019-11-25T10:28:50.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.827+0000 7fb1796c3ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-25T10:28:50.825 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.833+0000 7fb1796c3ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-25T10:28:50.825 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.833+0000 7fb1796c3ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-25T10:28:50.826 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.833+0000 7fb1796c3ec0 20 get_system_obj_state: rctx=0x7ffd53076c78 obj=default.rgw.meta:users.keys:HFQOFSLPWPXHSNLQOFSG state=0x558134cb0140 s->prefetch_data=0 2019-11-25T10:28:50.826 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.833+0000 7fb1796c3ec0 10 cache get: name=default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG : miss 2019-11-25T10:28:50.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.839+0000 7fb1796c3ec0 10 cache put: name=default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG info.flags=0x0 2019-11-25T10:28:50.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.839+0000 7fb1796c3ec0 10 adding default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG to cache LRU end 2019-11-25T10:28:50.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.840+0000 7fb1796c3ec0 20 get_system_obj_state: rctx=0x7ffd53076888 obj=default.rgw.meta:users.keys:HFQOFSLPWPXHSNLQOFSG state=0x558134cb0140 s->prefetch_data=0 2019-11-25T10:28:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.840+0000 7fb1796c3ec0 10 cache get: name=default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG : type miss (requested=0x6, cached=0x0) 2019-11-25T10:28:50.839 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.846+0000 7fb1796c3ec0 10 cache put: name=default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG info.flags=0x0 2019-11-25T10:28:50.839 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.846+0000 7fb1796c3ec0 10 moving default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG to cache LRU end 2019-11-25T10:28:50.839 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.846+0000 7fb1796c3ec0 20 get_system_obj_state: rctx=0x7ffd53076a08 obj=default.rgw.meta:users.keys:HFQOFSLPWPXHSNLQOFSG state=0x558134cb0140 s->prefetch_data=0 2019-11-25T10:28:50.839 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.846+0000 7fb1796c3ec0 10 cache get: name=default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG : type miss (requested=0x6, cached=0x0) 2019-11-25T10:28:50.845 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.853+0000 7fb1796c3ec0 10 cache put: name=default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG info.flags=0x0 2019-11-25T10:28:50.845 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.853+0000 7fb1796c3ec0 10 moving default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG to cache LRU end 2019-11-25T10:28:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.896+0000 7fb1796c3ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-25T10:28:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.896+0000 7fb1796c3ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T10:28:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.896+0000 7fb1796c3ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=617 2019-11-25T10:28:50.898 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.905+0000 7fb147fff700 10 RGWWatcher::handle_notify() notify_id 575525617727 cookie 94013424300736 notifier 4935 bl.length()=617 2019-11-25T10:28:50.898 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.905+0000 7fb147fff700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-25T10:28:50.898 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:50.905+0000 7fb147fff700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T10:28:51.202 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.209+0000 7fb1796c3ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-25T10:28:51.202 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.209+0000 7fb1796c3ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-25T10:28:51.203 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.209+0000 7fb1796c3ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-25T10:28:51.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.227+0000 7fb147fff700 10 RGWWatcher::handle_notify() notify_id 575525617728 cookie 94013424300736 notifier 4935 bl.length()=194 2019-11-25T10:28:51.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.227+0000 7fb147fff700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-25T10:28:51.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.227+0000 7fb147fff700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-25T10:28:51.620 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.628+0000 7fb1796c3ec0 10 cache put: name=default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG info.flags=0x7 2019-11-25T10:28:51.620 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.628+0000 7fb1796c3ec0 10 moving default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG to cache LRU end 2019-11-25T10:28:51.621 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.628+0000 7fb1796c3ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=186 2019-11-25T10:28:51.630 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.638+0000 7fb147fff700 10 RGWWatcher::handle_notify() notify_id 575525617684 cookie 94013424308880 notifier 4935 bl.length()=186 2019-11-25T10:28:51.630 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.638+0000 7fb147fff700 10 cache put: name=default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG info.flags=0x7 2019-11-25T10:28:51.630 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.638+0000 7fb147fff700 10 moving default.rgw.meta+users.keys+HFQOFSLPWPXHSNLQOFSG to cache LRU end 2019-11-25T10:28:51.923 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2019-11-25T10:28:51.923 INFO:teuthology.orchestra.run.smithi135.stdout: "user_id": "bar.client.0", 2019-11-25T10:28:51.923 INFO:teuthology.orchestra.run.smithi135.stdout: "display_name": "Mr. bar.client.0", 2019-11-25T10:28:51.923 INFO:teuthology.orchestra.run.smithi135.stdout: "email": "bar.client.0+test@test.test", 2019-11-25T10:28:51.923 INFO:teuthology.orchestra.run.smithi135.stdout: "suspended": 0, 2019-11-25T10:28:51.924 INFO:teuthology.orchestra.run.smithi135.stdout: "max_buckets": 1000, 2019-11-25T10:28:51.924 INFO:teuthology.orchestra.run.smithi135.stdout: "subusers": [], 2019-11-25T10:28:51.924 INFO:teuthology.orchestra.run.smithi135.stdout: "keys": [ 2019-11-25T10:28:51.924 INFO:teuthology.orchestra.run.smithi135.stdout: { 2019-11-25T10:28:51.924 INFO:teuthology.orchestra.run.smithi135.stdout: "user": "bar.client.0", 2019-11-25T10:28:51.924 INFO:teuthology.orchestra.run.smithi135.stdout: "access_key": "HFQOFSLPWPXHSNLQOFSG", 2019-11-25T10:28:51.924 INFO:teuthology.orchestra.run.smithi135.stdout: "secret_key": "7/E//j/3ShGYLUSI0kLl9rjA+ct3WbuDrkaXJveJUnSd0bdk/azw7w==" 2019-11-25T10:28:51.925 INFO:teuthology.orchestra.run.smithi135.stdout: } 2019-11-25T10:28:51.925 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2019-11-25T10:28:51.925 INFO:teuthology.orchestra.run.smithi135.stdout: "swift_keys": [], 2019-11-25T10:28:51.925 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": [], 2019-11-25T10:28:51.925 INFO:teuthology.orchestra.run.smithi135.stdout: "op_mask": "read, write, delete", 2019-11-25T10:28:51.925 INFO:teuthology.orchestra.run.smithi135.stdout: "default_placement": "", 2019-11-25T10:28:51.925 INFO:teuthology.orchestra.run.smithi135.stdout: "default_storage_class": "", 2019-11-25T10:28:51.926 INFO:teuthology.orchestra.run.smithi135.stdout: "placement_tags": [], 2019-11-25T10:28:51.926 INFO:teuthology.orchestra.run.smithi135.stdout: "bucket_quota": { 2019-11-25T10:28:51.926 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T10:28:51.926 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T10:28:51.926 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T10:28:51.926 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T10:28:51.926 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T10:28:51.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T10:28:51.927 INFO:teuthology.orchestra.run.smithi135.stdout: "user_quota": { 2019-11-25T10:28:51.927 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T10:28:51.927 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T10:28:51.927 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T10:28:51.927 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T10:28:51.927 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T10:28:51.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T10:28:51.928 INFO:teuthology.orchestra.run.smithi135.stdout: "temp_url_keys": [], 2019-11-25T10:28:51.928 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "rgw", 2019-11-25T10:28:51.928 INFO:teuthology.orchestra.run.smithi135.stdout: "mfa_ids": [] 2019-11-25T10:28:51.928 INFO:teuthology.orchestra.run.smithi135.stdout:} 2019-11-25T10:28:51.928 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:28:51.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.981+0000 7fb1796c3ec0 20 remove_watcher() i=0 2019-11-25T10:28:51.973 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:51.981+0000 7fb1796c3ec0 2 removed watcher, disabling cache 2019-11-25T10:28:52.046 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.054+0000 7fb1796c3ec0 20 remove_watcher() i=1 2019-11-25T10:28:52.099 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.106+0000 7fb1796c3ec0 20 remove_watcher() i=2 2019-11-25T10:28:52.163 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.170+0000 7fb1796c3ec0 20 remove_watcher() i=3 2019-11-25T10:28:52.204 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.211+0000 7fb1796c3ec0 20 remove_watcher() i=4 2019-11-25T10:28:52.239 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.247+0000 7fb1796c3ec0 20 remove_watcher() i=5 2019-11-25T10:28:52.274 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.281+0000 7fb1796c3ec0 20 remove_watcher() i=6 2019-11-25T10:28:52.311 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.318+0000 7fb1796c3ec0 20 remove_watcher() i=7 2019-11-25T10:28:52.317 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7072854944 --totp-seed O3ZKRQZBCJUFCW7DKN253PECG7OMWZ5S2SUBL2FMEJ4EZVMJ3QIFQA6U2ITD6TXR --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-25T10:28:52.443 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.451+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.470 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.478+0000 7fbaf8521ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:52.470 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.478+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.479 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.487+0000 7fbaf8521ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:52.480 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.487+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.502+0000 7fbaf8521ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:52.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.502+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.514 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.522+0000 7fbaf8521ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:52.734 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.742+0000 7fbaf8521ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:28:52.734 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.742+0000 7fbaf8521ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:28:52.735 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.742+0000 7fbaf8521ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:28:52.735 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.742+0000 7fbaf8521ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:28:52.735 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.742+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.750 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.757+0000 7fbaf8521ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:52.750 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.757+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.765 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.773+0000 7fbaf8521ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:28:52.765 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.773+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.791+0000 7fbaf8521ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:52.784 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.791+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.798 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.806+0000 7fbaf8521ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:28:52.798 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.806+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.813+0000 7fbaf8521ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:52.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.813+0000 7fbaf8521ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:28:52.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.813+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.815 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.822+0000 7fbaf8521ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:52.815 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.822+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.825 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.833+0000 7fbaf8521ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:52.826 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.833+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.840 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.848+0000 7fbaf8521ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:28:52.841 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.848+0000 7fbaf8521ec0 20 zonegroup default 2019-11-25T10:28:52.841 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.848+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.851 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.859+0000 7fbaf8521ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:52.851 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.859+0000 7fbaf8521ec0 10 Cannot find current period zone using local zone 2019-11-25T10:28:52.851 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.859+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.860 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.867+0000 7fbaf8521ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:52.860 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.867+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.882+0000 7fbaf8521ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:52.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.882+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:52.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.894+0000 7fbaf8521ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:28:52.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.895+0000 7fbaf8521ec0 20 zone default found 2019-11-25T10:28:52.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.895+0000 7fbaf8521ec0 20 started sync module instance, tier type = 2019-11-25T10:28:52.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:52.895+0000 7fbaf8521ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:28:53.219 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.227+0000 7fbaf8521ec0 20 add_watcher() i=0 2019-11-25T10:28:53.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.227+0000 7fbaf8521ec0 20 add_watcher() i=1 2019-11-25T10:28:53.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.227+0000 7fbaf8521ec0 20 add_watcher() i=2 2019-11-25T10:28:53.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.227+0000 7fbaf8521ec0 20 add_watcher() i=3 2019-11-25T10:28:53.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.227+0000 7fbaf8521ec0 20 add_watcher() i=4 2019-11-25T10:28:53.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.227+0000 7fbaf8521ec0 20 add_watcher() i=5 2019-11-25T10:28:53.220 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.227+0000 7fbaf8521ec0 20 add_watcher() i=6 2019-11-25T10:28:53.250 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.257+0000 7fbaf8521ec0 20 add_watcher() i=7 2019-11-25T10:28:53.250 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.257+0000 7fbaf8521ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:28:53.250 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.257+0000 7fbab5fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:28:53.252 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.259+0000 7fbae5f50700 0 -- 172.21.15.135:0/3647572354 >> v2:172.21.15.174:3300/0 conn(0x55f0e4c3ff30 msgr2=0x55f0e4c40340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-11-25T10:28:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:53.304+0000 7fbae4f4e700 0 -- 172.21.15.135:0/3616750390 >> [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] conn(0x55f0e4c58170 msgr2=0x55f0e4c5a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:28:55.486 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.493+0000 7fba27fff700 20 reqs_thread_entry: start 2019-11-25T10:28:55.487 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.494+0000 7fba25ffb700 20 reqs_thread_entry: start 2019-11-25T10:28:55.487 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.494+0000 7fbaf8521ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:28:55.487 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.495+0000 7fba13fff700 20 reqs_thread_entry: start 2019-11-25T10:28:55.488 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.495+0000 7fbaf8521ec0 20 get_system_obj_state: rctx=0x7ffd6ebf1398 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55f0e4cc1910 s->prefetch_data=0 2019-11-25T10:28:55.488 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.495+0000 7fbaf8521ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-25T10:28:55.510 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.518+0000 7fbaf8521ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-25T10:28:55.510 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.518+0000 7fbaf8521ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T10:28:55.511 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.518+0000 7fbaf8521ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T10:28:55.511 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.518+0000 7fbaf8521ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T10:28:55.511 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.518+0000 7fbaf8521ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-25T10:28:55.511 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.518+0000 7fbaf8521ec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:55.533 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.541+0000 7fbaf8521ec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-25T10:28:55.534 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.541+0000 7fbaf8521ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-25T10:28:55.534 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:55.541+0000 7fbaf8521ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T10:28:58.353 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:58.361+0000 7fbaf8521ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-25T10:28:58.354 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:58.361+0000 7fbaf8521ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T10:28:58.354 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:58.361+0000 7fbaf8521ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=631 2019-11-25T10:28:58.669 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:58.676+0000 7fbac67fc700 10 RGWWatcher::handle_notify() notify_id 588410519617 cookie 94493118497520 notifier 4950 bl.length()=631 2019-11-25T10:28:58.669 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:58.676+0000 7fbac67fc700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-25T10:28:58.670 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:58.676+0000 7fbac67fc700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T10:28:59.193 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.200+0000 7fbaf8521ec0 20 remove_watcher() i=0 2019-11-25T10:28:59.193 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.200+0000 7fbaf8521ec0 2 removed watcher, disabling cache 2019-11-25T10:28:59.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.239+0000 7fbaf8521ec0 20 remove_watcher() i=1 2019-11-25T10:28:59.272 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.279+0000 7fbaf8521ec0 20 remove_watcher() i=2 2019-11-25T10:28:59.313 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.320+0000 7fbaf8521ec0 20 remove_watcher() i=3 2019-11-25T10:28:59.362 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.369+0000 7fbaf8521ec0 20 remove_watcher() i=4 2019-11-25T10:28:59.406 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.413+0000 7fbaf8521ec0 20 remove_watcher() i=5 2019-11-25T10:28:59.448 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.455+0000 7fbaf8521ec0 20 remove_watcher() i=6 2019-11-25T10:28:59.483 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.491+0000 7fbaf8521ec0 20 remove_watcher() i=7 2019-11-25T10:28:59.491 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2019-11-25T10:28:59.491 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key IAYFINFLWKVADFPLMXOU --secret 1N2U9BSxmIftoimuwoRcFtVlJC0P6EzAao18qx1DQI+VRtrfgo9mVQ== --email foo.client.0+test@test.test --cluster ceph 2019-11-25T10:28:59.606 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.613+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.626 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.633+0000 7f72c40dfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:59.626 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.633+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.631 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.638+0000 7f72c40dfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:59.631 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.638+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.636 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.643+0000 7f72c40dfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:59.636 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.643+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.651 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.658+0000 7f72c40dfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:59.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.839+0000 7f72c40dfec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:28:59.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.839+0000 7f72c40dfec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:28:59.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.839+0000 7f72c40dfec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:28:59.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.839+0000 7f72c40dfec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:28:59.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.839+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.841 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.849+0000 7f72c40dfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:59.841 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.849+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.854 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.861+0000 7f72c40dfec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:28:59.854 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.861+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.863 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.870+0000 7f72c40dfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:59.863 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.870+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.880+0000 7f72c40dfec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:28:59.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.880+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.882 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.889+0000 7f72c40dfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:59.882 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.889+0000 7f72c40dfec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:28:59.883 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.889+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.892 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.900+0000 7f72c40dfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:59.892 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.900+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.904 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.912+0000 7f72c40dfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:59.904 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.912+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.912 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.920+0000 7f72c40dfec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:28:59.912 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.920+0000 7f72c40dfec0 20 zonegroup default 2019-11-25T10:28:59.913 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.920+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.928+0000 7f72c40dfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:59.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.928+0000 7f72c40dfec0 10 Cannot find current period zone using local zone 2019-11-25T10:28:59.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.928+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.934+0000 7f72c40dfec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:28:59.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.934+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.939 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.946+0000 7f72c40dfec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:28:59.939 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.946+0000 7f72c40dfec0 20 rados->read ofs=0 len=0 2019-11-25T10:28:59.947 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.954+0000 7f72c40dfec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:28:59.947 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.955+0000 7f72c40dfec0 20 zone default found 2019-11-25T10:28:59.947 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.955+0000 7f72c40dfec0 20 started sync module instance, tier type = 2019-11-25T10:28:59.948 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:28:59.955+0000 7f72c40dfec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:29:00.302 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.309+0000 7f72c40dfec0 20 add_watcher() i=0 2019-11-25T10:29:00.302 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.309+0000 7f72c40dfec0 20 add_watcher() i=1 2019-11-25T10:29:00.302 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.309+0000 7f72c40dfec0 20 add_watcher() i=2 2019-11-25T10:29:00.302 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.309+0000 7f72c40dfec0 20 add_watcher() i=3 2019-11-25T10:29:00.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.309+0000 7f72c40dfec0 20 add_watcher() i=4 2019-11-25T10:29:00.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.309+0000 7f72c40dfec0 20 add_watcher() i=5 2019-11-25T10:29:00.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.310+0000 7f72c40dfec0 20 add_watcher() i=6 2019-11-25T10:29:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.338+0000 7f72c40dfec0 20 add_watcher() i=7 2019-11-25T10:29:00.330 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.338+0000 7f72c40dfec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:29:00.331 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.338+0000 7f7281fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:29:00.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.343+0000 7f72b0b0c700 0 -- 172.21.15.135:0/4238230147 >> v2:172.21.15.135:3300/0 conn(0x560c9da162f0 msgr2=0x560c9da18800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-25T10:29:00.538 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.546+0000 7f72b0b0c700 0 --2- 172.21.15.135:0/4238230147 >> v2:172.21.15.135:3300/0 conn(0x560c9da162f0 0x560c9da18800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-25T10:29:00.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:00.589+0000 7f72b0b0c700 0 -- 172.21.15.135:0/3684642701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c9da1c4d0 msgr2=0x560c9da1e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:29:02.260 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.267+0000 7f71f3fff700 20 reqs_thread_entry: start 2019-11-25T10:29:02.260 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.267+0000 7f71f1ffb700 20 reqs_thread_entry: start 2019-11-25T10:29:02.260 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.267+0000 7f72c40dfec0 20 init_complete bucket index max shards: 0 2019-11-25T10:29:02.261 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.268+0000 7f71dffff700 20 reqs_thread_entry: start 2019-11-25T10:29:02.261 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.268+0000 7f72c40dfec0 20 get_system_obj_state: rctx=0x7ffec7194dc8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x560c9da8e180 s->prefetch_data=0 2019-11-25T10:29:02.261 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.268+0000 7f72c40dfec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-25T10:29:02.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.276+0000 7f72c40dfec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-25T10:29:02.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.276+0000 7f72c40dfec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T10:29:02.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.276+0000 7f72c40dfec0 20 get_system_obj_state: rctx=0x7ffec7194dd8 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x560c9da8ff10 s->prefetch_data=0 2019-11-25T10:29:02.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.276+0000 7f72c40dfec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-25T10:29:02.277 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.285+0000 7f72c40dfec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-25T10:29:02.277 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.285+0000 7f72c40dfec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-25T10:29:02.278 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.285+0000 7f72c40dfec0 20 get_system_obj_state: rctx=0x7ffec7194dd8 obj=default.rgw.meta:users.keys:IAYFINFLWKVADFPLMXOU state=0x560c9da8ff10 s->prefetch_data=0 2019-11-25T10:29:02.278 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.285+0000 7f72c40dfec0 10 cache get: name=default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU : miss 2019-11-25T10:29:02.283 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.290+0000 7f72c40dfec0 10 cache put: name=default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU info.flags=0x0 2019-11-25T10:29:02.283 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.290+0000 7f72c40dfec0 10 adding default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU to cache LRU end 2019-11-25T10:29:02.283 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.290+0000 7f72c40dfec0 20 get_system_obj_state: rctx=0x7ffec71949e8 obj=default.rgw.meta:users.keys:IAYFINFLWKVADFPLMXOU state=0x560c9da8ff10 s->prefetch_data=0 2019-11-25T10:29:02.283 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.290+0000 7f72c40dfec0 10 cache get: name=default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU : type miss (requested=0x6, cached=0x0) 2019-11-25T10:29:02.289 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.296+0000 7f72c40dfec0 10 cache put: name=default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU info.flags=0x0 2019-11-25T10:29:02.289 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.296+0000 7f72c40dfec0 10 moving default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU to cache LRU end 2019-11-25T10:29:02.289 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.296+0000 7f72c40dfec0 20 get_system_obj_state: rctx=0x7ffec7194b68 obj=default.rgw.meta:users.keys:IAYFINFLWKVADFPLMXOU state=0x560c9da8ff10 s->prefetch_data=0 2019-11-25T10:29:02.290 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.296+0000 7f72c40dfec0 10 cache get: name=default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU : type miss (requested=0x6, cached=0x0) 2019-11-25T10:29:02.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.301+0000 7f72c40dfec0 10 cache put: name=default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU info.flags=0x0 2019-11-25T10:29:02.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.301+0000 7f72c40dfec0 10 moving default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU to cache LRU end 2019-11-25T10:29:02.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.342+0000 7f72c40dfec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-25T10:29:02.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.342+0000 7f72c40dfec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T10:29:02.335 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.342+0000 7f72c40dfec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=617 2019-11-25T10:29:02.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.352+0000 7f72927fc700 10 RGWWatcher::handle_notify() notify_id 588410519608 cookie 94612184099088 notifier 4625 bl.length()=617 2019-11-25T10:29:02.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.352+0000 7f72927fc700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-25T10:29:02.345 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.352+0000 7f72927fc700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T10:29:02.637 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.644+0000 7f72c40dfec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-25T10:29:02.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.644+0000 7f72c40dfec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-25T10:29:02.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.645+0000 7f72c40dfec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-25T10:29:02.647 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.655+0000 7f72927fc700 10 RGWWatcher::handle_notify() notify_id 588410519573 cookie 94612184110576 notifier 4625 bl.length()=194 2019-11-25T10:29:02.647 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.655+0000 7f72927fc700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-25T10:29:02.648 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.655+0000 7f72927fc700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-25T10:29:02.799 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.806+0000 7f72c40dfec0 10 cache put: name=default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU info.flags=0x7 2019-11-25T10:29:02.799 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.806+0000 7f72c40dfec0 10 moving default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU to cache LRU end 2019-11-25T10:29:02.799 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.806+0000 7f72c40dfec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=186 2019-11-25T10:29:02.807 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.814+0000 7f72927fc700 10 RGWWatcher::handle_notify() notify_id 588410519609 cookie 94612184116544 notifier 4625 bl.length()=186 2019-11-25T10:29:02.807 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.814+0000 7f72927fc700 10 cache put: name=default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU info.flags=0x7 2019-11-25T10:29:02.807 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:02.814+0000 7f72927fc700 10 moving default.rgw.meta+users.keys+IAYFINFLWKVADFPLMXOU to cache LRU end 2019-11-25T10:29:03.120 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2019-11-25T10:29:03.120 INFO:teuthology.orchestra.run.smithi135.stdout: "user_id": "foo.client.0", 2019-11-25T10:29:03.120 INFO:teuthology.orchestra.run.smithi135.stdout: "display_name": "Mr. foo.client.0", 2019-11-25T10:29:03.120 INFO:teuthology.orchestra.run.smithi135.stdout: "email": "foo.client.0+test@test.test", 2019-11-25T10:29:03.121 INFO:teuthology.orchestra.run.smithi135.stdout: "suspended": 0, 2019-11-25T10:29:03.121 INFO:teuthology.orchestra.run.smithi135.stdout: "max_buckets": 1000, 2019-11-25T10:29:03.121 INFO:teuthology.orchestra.run.smithi135.stdout: "subusers": [], 2019-11-25T10:29:03.121 INFO:teuthology.orchestra.run.smithi135.stdout: "keys": [ 2019-11-25T10:29:03.121 INFO:teuthology.orchestra.run.smithi135.stdout: { 2019-11-25T10:29:03.121 INFO:teuthology.orchestra.run.smithi135.stdout: "user": "foo.client.0", 2019-11-25T10:29:03.122 INFO:teuthology.orchestra.run.smithi135.stdout: "access_key": "IAYFINFLWKVADFPLMXOU", 2019-11-25T10:29:03.122 INFO:teuthology.orchestra.run.smithi135.stdout: "secret_key": "1N2U9BSxmIftoimuwoRcFtVlJC0P6EzAao18qx1DQI+VRtrfgo9mVQ==" 2019-11-25T10:29:03.122 INFO:teuthology.orchestra.run.smithi135.stdout: } 2019-11-25T10:29:03.122 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2019-11-25T10:29:03.122 INFO:teuthology.orchestra.run.smithi135.stdout: "swift_keys": [], 2019-11-25T10:29:03.122 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": [], 2019-11-25T10:29:03.122 INFO:teuthology.orchestra.run.smithi135.stdout: "op_mask": "read, write, delete", 2019-11-25T10:29:03.123 INFO:teuthology.orchestra.run.smithi135.stdout: "default_placement": "", 2019-11-25T10:29:03.123 INFO:teuthology.orchestra.run.smithi135.stdout: "default_storage_class": "", 2019-11-25T10:29:03.123 INFO:teuthology.orchestra.run.smithi135.stdout: "placement_tags": [], 2019-11-25T10:29:03.123 INFO:teuthology.orchestra.run.smithi135.stdout: "bucket_quota": { 2019-11-25T10:29:03.123 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T10:29:03.123 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T10:29:03.123 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T10:29:03.124 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T10:29:03.124 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T10:29:03.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T10:29:03.124 INFO:teuthology.orchestra.run.smithi135.stdout: "user_quota": { 2019-11-25T10:29:03.124 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T10:29:03.124 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T10:29:03.124 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T10:29:03.125 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T10:29:03.125 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T10:29:03.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T10:29:03.125 INFO:teuthology.orchestra.run.smithi135.stdout: "temp_url_keys": [], 2019-11-25T10:29:03.125 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "rgw", 2019-11-25T10:29:03.125 INFO:teuthology.orchestra.run.smithi135.stdout: "mfa_ids": [] 2019-11-25T10:29:03.125 INFO:teuthology.orchestra.run.smithi135.stdout:} 2019-11-25T10:29:03.125 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:03.186 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.193+0000 7f72c40dfec0 20 remove_watcher() i=0 2019-11-25T10:29:03.186 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.193+0000 7f72c40dfec0 2 removed watcher, disabling cache 2019-11-25T10:29:03.250 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.257+0000 7f72c40dfec0 20 remove_watcher() i=1 2019-11-25T10:29:03.310 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.318+0000 7f72c40dfec0 20 remove_watcher() i=2 2019-11-25T10:29:03.367 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.374+0000 7f72c40dfec0 20 remove_watcher() i=3 2019-11-25T10:29:03.409 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.416+0000 7f72c40dfec0 20 remove_watcher() i=4 2019-11-25T10:29:03.477 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.484+0000 7f72c40dfec0 20 remove_watcher() i=5 2019-11-25T10:29:03.540 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.547+0000 7f72c40dfec0 20 remove_watcher() i=6 2019-11-25T10:29:03.590 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.597+0000 7f72c40dfec0 20 remove_watcher() i=7 2019-11-25T10:29:03.602 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5941593067 --totp-seed 3UU265Z2LZM63EGVMQG4WORIIYZMDHUIJGHGEMKVVXIG3ULJX6LIGXGQJMBDLT5C --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-25T10:29:03.736 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.743+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:03.767 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.774+0000 7fa405301ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:03.767 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.774+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:03.774 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.781+0000 7fa405301ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:03.774 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.781+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:03.781 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.789+0000 7fa405301ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:03.782 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.789+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:03.800 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:03.807+0000 7fa405301ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:04.058 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.065+0000 7fa405301ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:29:04.058 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.065+0000 7fa405301ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:29:04.059 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.065+0000 7fa405301ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:29:04.059 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.065+0000 7fa405301ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:29:04.059 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.065+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.073+0000 7fa405301ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:04.066 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.073+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.081 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.088+0000 7fa405301ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:29:04.081 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.089+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.101+0000 7fa405301ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:04.094 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.101+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.105 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.112+0000 7fa405301ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:29:04.105 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.112+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.112 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.119+0000 7fa405301ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:04.112 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.119+0000 7fa405301ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:29:04.112 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.119+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.117 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.125+0000 7fa405301ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:04.117 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.125+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.130 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.137+0000 7fa405301ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:04.130 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.137+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.148 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.155+0000 7fa405301ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:29:04.148 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.155+0000 7fa405301ec0 20 zonegroup default 2019-11-25T10:29:04.148 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.155+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.164 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.171+0000 7fa405301ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:04.164 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.171+0000 7fa405301ec0 10 Cannot find current period zone using local zone 2019-11-25T10:29:04.165 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.171+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.178+0000 7fa405301ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:04.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.178+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.189+0000 7fa405301ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:04.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.189+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:04.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.200+0000 7fa405301ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:29:04.193 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.200+0000 7fa405301ec0 20 zone default found 2019-11-25T10:29:04.193 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.200+0000 7fa405301ec0 20 started sync module instance, tier type = 2019-11-25T10:29:04.193 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.200+0000 7fa405301ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:29:04.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.509+0000 7fa405301ec0 20 add_watcher() i=0 2019-11-25T10:29:04.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.509+0000 7fa405301ec0 20 add_watcher() i=1 2019-11-25T10:29:04.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.509+0000 7fa405301ec0 20 add_watcher() i=2 2019-11-25T10:29:04.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.509+0000 7fa405301ec0 20 add_watcher() i=3 2019-11-25T10:29:04.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.509+0000 7fa405301ec0 20 add_watcher() i=4 2019-11-25T10:29:04.503 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.509+0000 7fa405301ec0 20 add_watcher() i=5 2019-11-25T10:29:04.506 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.513+0000 7fa405301ec0 20 add_watcher() i=6 2019-11-25T10:29:04.530 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.537+0000 7fa405301ec0 20 add_watcher() i=7 2019-11-25T10:29:04.530 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.537+0000 7fa405301ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:29:04.531 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.537+0000 7fa3c27e4700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:29:04.542 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.549+0000 7fa3f2d30700 0 -- 172.21.15.135:0/1988515349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559eb1bc0f30 msgr2=0x559eb1bc1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:29:04.615 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:04.622+0000 7fa3f1d2e700 0 -- 172.21.15.135:0/939055981 >> [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] conn(0x559eb1bda6b0 msgr2=0x559eb1bdcad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:29:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.148+0000 7fa338ff9700 20 reqs_thread_entry: start 2019-11-25T10:29:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.148+0000 7fa3327fc700 20 reqs_thread_entry: start 2019-11-25T10:29:06.142 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.148+0000 7fa405301ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:29:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.149+0000 7fa330ff9700 20 reqs_thread_entry: start 2019-11-25T10:29:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.149+0000 7fa405301ec0 20 get_system_obj_state: rctx=0x7ffc9ff016a8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x559eb1c41210 s->prefetch_data=0 2019-11-25T10:29:06.143 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.149+0000 7fa405301ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-25T10:29:06.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.163+0000 7fa405301ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-25T10:29:06.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.163+0000 7fa405301ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T10:29:06.157 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.163+0000 7fa405301ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T10:29:06.158 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.163+0000 7fa405301ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T10:29:06.158 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.163+0000 7fa405301ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-25T10:29:06.158 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.163+0000 7fa405301ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:06.170 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.177+0000 7fa405301ec0 20 rados_obj.operate() r=0 bl.length=432 2019-11-25T10:29:06.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.177+0000 7fa405301ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-25T10:29:06.171 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.177+0000 7fa405301ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T10:29:06.379 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.385+0000 7fa405301ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-25T10:29:06.380 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.385+0000 7fa405301ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T10:29:06.380 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.385+0000 7fa405301ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=631 2019-11-25T10:29:06.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.395+0000 7fa3d77fe700 10 RGWWatcher::handle_notify() notify_id 588410519610 cookie 94140075018976 notifier 4983 bl.length()=631 2019-11-25T10:29:06.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.395+0000 7fa3d77fe700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-25T10:29:06.389 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:06.395+0000 7fa3d77fe700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T10:29:07.001 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.007+0000 7fa405301ec0 20 remove_watcher() i=0 2019-11-25T10:29:07.001 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.007+0000 7fa405301ec0 2 removed watcher, disabling cache 2019-11-25T10:29:07.065 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.071+0000 7fa405301ec0 20 remove_watcher() i=1 2019-11-25T10:29:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.117+0000 7fa405301ec0 20 remove_watcher() i=2 2019-11-25T10:29:07.149 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.156+0000 7fa405301ec0 20 remove_watcher() i=3 2019-11-25T10:29:07.203 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.210+0000 7fa405301ec0 20 remove_watcher() i=4 2019-11-25T10:29:07.249 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.255+0000 7fa405301ec0 20 remove_watcher() i=5 2019-11-25T10:29:07.310 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.316+0000 7fa405301ec0 20 remove_watcher() i=6 2019-11-25T10:29:07.351 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.357+0000 7fa405301ec0 20 remove_watcher() i=7 2019-11-25T10:29:07.356 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2019-11-25T10:29:07.356 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --access-key VKFDEXRGAVQTIJTYMLQI --secret XZCTFxGqfrdvVQ+zQeqVnpQ+/k5TkLARF1QantFiZjGzLv/k+W6HEA== --email 'testx$tenanteduser.client.0+test@test.test' --cluster ceph 2019-11-25T10:29:07.495 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.501+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.524 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.531+0000 7f330c120ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:07.525 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.531+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.534 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.541+0000 7f330c120ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:07.534 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.541+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.546 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.552+0000 7f330c120ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:07.546 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.552+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.569 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.575+0000 7f330c120ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:07.782 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.788+0000 7f330c120ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:29:07.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.788+0000 7f330c120ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:29:07.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.788+0000 7f330c120ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:29:07.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.788+0000 7f330c120ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:29:07.783 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.788+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.798 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.804+0000 7f330c120ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:07.798 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.804+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.818 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.824+0000 7f330c120ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:29:07.818 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.824+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.836 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.842+0000 7f330c120ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:07.836 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.842+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.860+0000 7f330c120ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:29:07.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.861+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.865 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.871+0000 7f330c120ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:07.865 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.871+0000 7f330c120ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:29:07.865 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.871+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.880+0000 7f330c120ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:07.874 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.880+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.895+0000 7f330c120ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:07.889 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.895+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.911 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.917+0000 7f330c120ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:29:07.911 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.917+0000 7f330c120ec0 20 zonegroup default 2019-11-25T10:29:07.911 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.917+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.926+0000 7f330c120ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:07.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.926+0000 7f330c120ec0 10 Cannot find current period zone using local zone 2019-11-25T10:29:07.920 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.926+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.933+0000 7f330c120ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:07.927 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.933+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.939 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.946+0000 7f330c120ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:07.939 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.946+0000 7f330c120ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:07.951 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.957+0000 7f330c120ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:29:07.951 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.957+0000 7f330c120ec0 20 zone default found 2019-11-25T10:29:07.951 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.957+0000 7f330c120ec0 20 started sync module instance, tier type = 2019-11-25T10:29:07.951 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:07.957+0000 7f330c120ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:29:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.310+0000 7f330c120ec0 20 add_watcher() i=0 2019-11-25T10:29:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.310+0000 7f330c120ec0 20 add_watcher() i=1 2019-11-25T10:29:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.310+0000 7f330c120ec0 20 add_watcher() i=2 2019-11-25T10:29:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.310+0000 7f330c120ec0 20 add_watcher() i=3 2019-11-25T10:29:08.304 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.310+0000 7f330c120ec0 20 add_watcher() i=4 2019-11-25T10:29:08.304 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.310+0000 7f330c120ec0 20 add_watcher() i=5 2019-11-25T10:29:08.304 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.310+0000 7f330c120ec0 20 add_watcher() i=6 2019-11-25T10:29:08.344 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.351+0000 7f330c120ec0 20 add_watcher() i=7 2019-11-25T10:29:08.344 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.351+0000 7f330c120ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:29:08.344 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.351+0000 7f32c9fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:29:08.346 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.353+0000 7f32f934e700 0 -- 172.21.15.135:0/2499163526 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55f352a624d0 msgr2=0x55f352a64910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-11-25T10:29:08.384 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:08.391+0000 7f32f934e700 0 -- 172.21.15.135:0/555949193 >> [v2:172.21.15.174:6800/8260,v1:172.21.15.174:6801/8260] conn(0x7f323c017570 msgr2=0x7f323c019a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:29:09.974 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:09.981+0000 7f323bfff700 20 reqs_thread_entry: start 2019-11-25T10:29:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:09.981+0000 7f3239ffb700 20 reqs_thread_entry: start 2019-11-25T10:29:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:09.982+0000 7f330c120ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:29:09.975 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:09.982+0000 7f3227fff700 20 reqs_thread_entry: start 2019-11-25T10:29:09.976 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:09.983+0000 7f330c120ec0 20 get_system_obj_state: rctx=0x7fff00808f48 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55f352ae0e80 s->prefetch_data=0 2019-11-25T10:29:09.976 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:09.983+0000 7f330c120ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-25T10:29:09.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:09.995+0000 7f330c120ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2019-11-25T10:29:09.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:09.995+0000 7f330c120ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T10:29:09.988 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:09.995+0000 7f330c120ec0 20 get_system_obj_state: rctx=0x7fff00808f58 obj=default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test state=0x55f352ae2c30 s->prefetch_data=0 2019-11-25T10:29:09.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:09.995+0000 7f330c120ec0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2019-11-25T10:29:09.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.006+0000 7f330c120ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2019-11-25T10:29:09.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.006+0000 7f330c120ec0 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-25T10:29:09.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.006+0000 7f330c120ec0 20 get_system_obj_state: rctx=0x7fff00808f58 obj=default.rgw.meta:users.keys:VKFDEXRGAVQTIJTYMLQI state=0x55f352ae2c30 s->prefetch_data=0 2019-11-25T10:29:09.999 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.006+0000 7f330c120ec0 10 cache get: name=default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI : miss 2019-11-25T10:29:10.009 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.016+0000 7f330c120ec0 10 cache put: name=default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI info.flags=0x0 2019-11-25T10:29:10.009 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.016+0000 7f330c120ec0 10 adding default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI to cache LRU end 2019-11-25T10:29:10.009 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.016+0000 7f330c120ec0 20 get_system_obj_state: rctx=0x7fff00808b68 obj=default.rgw.meta:users.keys:VKFDEXRGAVQTIJTYMLQI state=0x55f352ae2c30 s->prefetch_data=0 2019-11-25T10:29:10.009 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.016+0000 7f330c120ec0 10 cache get: name=default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI : type miss (requested=0x6, cached=0x0) 2019-11-25T10:29:10.021 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.028+0000 7f330c120ec0 10 cache put: name=default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI info.flags=0x0 2019-11-25T10:29:10.061 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.028+0000 7f330c120ec0 10 moving default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI to cache LRU end 2019-11-25T10:29:10.061 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.028+0000 7f330c120ec0 20 get_system_obj_state: rctx=0x7fff00808ce8 obj=default.rgw.meta:users.keys:VKFDEXRGAVQTIJTYMLQI state=0x55f352ae2c30 s->prefetch_data=0 2019-11-25T10:29:10.061 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.028+0000 7f330c120ec0 10 cache get: name=default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI : type miss (requested=0x6, cached=0x0) 2019-11-25T10:29:10.062 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.038+0000 7f330c120ec0 10 cache put: name=default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI info.flags=0x0 2019-11-25T10:29:10.062 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.038+0000 7f330c120ec0 10 moving default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI to cache LRU end 2019-11-25T10:29:10.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.115+0000 7f330c120ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-25T10:29:10.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.115+0000 7f330c120ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T10:29:10.108 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.115+0000 7f330c120ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=691 2019-11-25T10:29:10.132 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.139+0000 7f32da7fc700 10 RGWWatcher::handle_notify() notify_id 588410519618 cookie 94503551968192 notifier 4640 bl.length()=691 2019-11-25T10:29:10.132 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.139+0000 7f32da7fc700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-25T10:29:10.132 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.139+0000 7f32da7fc700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T10:29:10.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.239+0000 7f32da7fc700 10 RGWWatcher::handle_notify() notify_id 588410519618 cookie 94503551968192 notifier 4640 bl.length()=691 2019-11-25T10:29:10.233 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.239+0000 7f32da7fc700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-25T10:29:10.233 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.239+0000 7f32da7fc700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T10:29:10.233 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.239+0000 7f32da7fc700 10 RGWWatcher::handle_notify() notify_id 588410519619 cookie 94503551968192 notifier 4640 bl.length()=691 2019-11-25T10:29:10.233 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.239+0000 7f32da7fc700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-25T10:29:10.233 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.239+0000 7f32da7fc700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T10:29:10.380 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.387+0000 7f330c120ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-25T10:29:10.380 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.387+0000 7f330c120ec0 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-25T10:29:10.380 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.387+0000 7f330c120ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=224 2019-11-25T10:29:10.397 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.404+0000 7f32da7fc700 10 RGWWatcher::handle_notify() notify_id 588410519611 cookie 94503551971776 notifier 4640 bl.length()=224 2019-11-25T10:29:10.397 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.404+0000 7f32da7fc700 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-11-25T10:29:10.398 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.404+0000 7f32da7fc700 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-11-25T10:29:10.757 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.764+0000 7f330c120ec0 10 cache put: name=default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI info.flags=0x7 2019-11-25T10:29:10.758 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.764+0000 7f330c120ec0 10 moving default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI to cache LRU end 2019-11-25T10:29:10.758 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.764+0000 7f330c120ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=201 2019-11-25T10:29:10.784 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.791+0000 7f32da7fc700 10 RGWWatcher::handle_notify() notify_id 588410519574 cookie 94503551965872 notifier 4640 bl.length()=201 2019-11-25T10:29:10.784 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.791+0000 7f32da7fc700 10 cache put: name=default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI info.flags=0x7 2019-11-25T10:29:10.784 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.791+0000 7f32da7fc700 10 moving default.rgw.meta+users.keys+VKFDEXRGAVQTIJTYMLQI to cache LRU end 2019-11-25T10:29:10.895 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2019-11-25T10:29:10.895 INFO:teuthology.orchestra.run.smithi135.stdout: "user_id": "testx$tenanteduser.client.0", 2019-11-25T10:29:10.895 INFO:teuthology.orchestra.run.smithi135.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2019-11-25T10:29:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2019-11-25T10:29:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "suspended": 0, 2019-11-25T10:29:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "max_buckets": 1000, 2019-11-25T10:29:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "subusers": [], 2019-11-25T10:29:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "keys": [ 2019-11-25T10:29:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: { 2019-11-25T10:29:10.896 INFO:teuthology.orchestra.run.smithi135.stdout: "user": "testx$tenanteduser.client.0", 2019-11-25T10:29:10.897 INFO:teuthology.orchestra.run.smithi135.stdout: "access_key": "VKFDEXRGAVQTIJTYMLQI", 2019-11-25T10:29:10.897 INFO:teuthology.orchestra.run.smithi135.stdout: "secret_key": "XZCTFxGqfrdvVQ+zQeqVnpQ+/k5TkLARF1QantFiZjGzLv/k+W6HEA==" 2019-11-25T10:29:10.897 INFO:teuthology.orchestra.run.smithi135.stdout: } 2019-11-25T10:29:10.897 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2019-11-25T10:29:10.897 INFO:teuthology.orchestra.run.smithi135.stdout: "swift_keys": [], 2019-11-25T10:29:10.897 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": [], 2019-11-25T10:29:10.897 INFO:teuthology.orchestra.run.smithi135.stdout: "op_mask": "read, write, delete", 2019-11-25T10:29:10.898 INFO:teuthology.orchestra.run.smithi135.stdout: "default_placement": "", 2019-11-25T10:29:10.898 INFO:teuthology.orchestra.run.smithi135.stdout: "default_storage_class": "", 2019-11-25T10:29:10.898 INFO:teuthology.orchestra.run.smithi135.stdout: "placement_tags": [], 2019-11-25T10:29:10.898 INFO:teuthology.orchestra.run.smithi135.stdout: "bucket_quota": { 2019-11-25T10:29:10.898 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T10:29:10.898 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T10:29:10.898 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T10:29:10.899 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T10:29:10.899 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T10:29:10.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T10:29:10.899 INFO:teuthology.orchestra.run.smithi135.stdout: "user_quota": { 2019-11-25T10:29:10.899 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T10:29:10.899 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T10:29:10.899 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T10:29:10.899 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T10:29:10.900 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T10:29:10.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T10:29:10.900 INFO:teuthology.orchestra.run.smithi135.stdout: "temp_url_keys": [], 2019-11-25T10:29:10.900 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "rgw", 2019-11-25T10:29:10.900 INFO:teuthology.orchestra.run.smithi135.stdout: "mfa_ids": [] 2019-11-25T10:29:10.900 INFO:teuthology.orchestra.run.smithi135.stdout:} 2019-11-25T10:29:10.900 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:10.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.944+0000 7f330c120ec0 20 remove_watcher() i=0 2019-11-25T10:29:10.937 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:10.944+0000 7f330c120ec0 2 removed watcher, disabling cache 2019-11-25T10:29:11.000 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.007+0000 7f330c120ec0 20 remove_watcher() i=1 2019-11-25T10:29:11.059 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.066+0000 7f330c120ec0 20 remove_watcher() i=2 2019-11-25T10:29:11.102 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.109+0000 7f330c120ec0 20 remove_watcher() i=3 2019-11-25T10:29:11.137 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.144+0000 7f330c120ec0 20 remove_watcher() i=4 2019-11-25T10:29:11.194 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.202+0000 7f330c120ec0 20 remove_watcher() i=5 2019-11-25T10:29:11.237 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.244+0000 7f330c120ec0 20 remove_watcher() i=6 2019-11-25T10:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.280+0000 7f330c120ec0 20 remove_watcher() i=7 2019-11-25T10:29:11.279 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 2040694085 --totp-seed X43FOPGT2QPBJ3MDVKQMQJEPMPZM3T5YSNMXYLLTTTWMQJKVBM3SIOIUXZ2UKKEN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-11-25T10:29:11.422 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.429+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.462+0000 7f0ad9970ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:11.455 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.462+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.466 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.473+0000 7f0ad9970ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:11.466 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.473+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.476 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.483+0000 7f0ad9970ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:11.510 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.483+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.510 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.509+0000 7f0ad9970ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.769+0000 7f0ad9970ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T10:29:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.769+0000 7f0ad9970ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T10:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.769+0000 7f0ad9970ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T10:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.769+0000 7f0ad9970ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T10:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.769+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.772 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.780+0000 7f0ad9970ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:11.773 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.780+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.791+0000 7f0ad9970ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.791+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.798 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.806+0000 7f0ad9970ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:11.798 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.806+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.812 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.819+0000 7f0ad9970ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:29:11.812 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.819+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.819 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.827+0000 7f0ad9970ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:11.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.827+0000 7f0ad9970ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T10:29:11.820 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.827+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.838+0000 7f0ad9970ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:11.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.838+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.841 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.848+0000 7f0ad9970ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:11.841 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.848+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.852 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.859+0000 7f0ad9970ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T10:29:11.852 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.859+0000 7f0ad9970ec0 20 zonegroup default 2019-11-25T10:29:11.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.859+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.859 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.866+0000 7f0ad9970ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:11.859 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.866+0000 7f0ad9970ec0 10 Cannot find current period zone using local zone 2019-11-25T10:29:11.859 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.866+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.865 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.872+0000 7f0ad9970ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T10:29:11.865 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.872+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.883+0000 7f0ad9970ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T10:29:11.876 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.883+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:11.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.893+0000 7f0ad9970ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T10:29:11.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.893+0000 7f0ad9970ec0 20 zone default found 2019-11-25T10:29:11.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.893+0000 7f0ad9970ec0 20 started sync module instance, tier type = 2019-11-25T10:29:11.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:11.893+0000 7f0ad9970ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T10:29:12.288 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.295+0000 7f0ad9970ec0 20 add_watcher() i=0 2019-11-25T10:29:12.288 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.295+0000 7f0ad9970ec0 20 add_watcher() i=1 2019-11-25T10:29:12.288 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.295+0000 7f0ad9970ec0 20 add_watcher() i=2 2019-11-25T10:29:12.288 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.295+0000 7f0ad9970ec0 20 add_watcher() i=3 2019-11-25T10:29:12.288 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.295+0000 7f0ad9970ec0 20 add_watcher() i=4 2019-11-25T10:29:12.289 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.295+0000 7f0ad9970ec0 20 add_watcher() i=5 2019-11-25T10:29:12.289 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.295+0000 7f0ad9970ec0 20 add_watcher() i=6 2019-11-25T10:29:12.317 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.323+0000 7f0ad9970ec0 20 add_watcher() i=7 2019-11-25T10:29:12.317 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.323+0000 7f0ad9970ec0 2 all 8 watchers are set, enabling cache 2019-11-25T10:29:12.317 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.323+0000 7f0a977de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T10:29:12.319 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.326+0000 7f0ac639d700 0 -- 172.21.15.135:0/2247951100 >> v1:172.21.15.135:6789/0 conn(0x558c00bc72a0 legacy=0x558c00bc97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-25T10:29:12.357 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:12.364+0000 7f0ac639d700 0 -- 172.21.15.135:0/1322216103 >> [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] conn(0x558c00bd96b0 msgr2=0x558c00bdbad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T10:29:13.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.892+0000 7f0a05ffb700 20 reqs_thread_entry: start 2019-11-25T10:29:13.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.892+0000 7f09ff7fe700 20 reqs_thread_entry: start 2019-11-25T10:29:13.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.892+0000 7f0ad9970ec0 20 init_complete bucket index max shards: 0 2019-11-25T10:29:13.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.893+0000 7f09fdffb700 20 reqs_thread_entry: start 2019-11-25T10:29:13.886 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.893+0000 7f0ad9970ec0 20 get_system_obj_state: rctx=0x7ffca28c84f8 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x558c00c42eb0 s->prefetch_data=0 2019-11-25T10:29:13.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.893+0000 7f0ad9970ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-25T10:29:13.897 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.904+0000 7f0ad9970ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-25T10:29:13.897 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.904+0000 7f0ad9970ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T10:29:13.898 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.905+0000 7f0ad9970ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T10:29:13.898 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.905+0000 7f0ad9970ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T10:29:13.898 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.905+0000 7f0ad9970ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-25T10:29:13.898 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.905+0000 7f0ad9970ec0 20 rados->read ofs=0 len=0 2019-11-25T10:29:13.909 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.916+0000 7f0ad9970ec0 20 rados_obj.operate() r=0 bl.length=491 2019-11-25T10:29:13.909 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.916+0000 7f0ad9970ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-25T10:29:13.910 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:13.916+0000 7f0ad9970ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T10:29:14.013 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.020+0000 7f0ad9970ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-25T10:29:14.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.020+0000 7f0ad9970ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T10:29:14.014 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.020+0000 7f0ad9970ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=705 2019-11-25T10:29:14.025 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.032+0000 7f0aa7fff700 10 RGWWatcher::handle_notify() notify_id 588410519620 cookie 94059796053056 notifier 5022 bl.length()=705 2019-11-25T10:29:14.025 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.032+0000 7f0aa7fff700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-11-25T10:29:14.025 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.032+0000 7f0aa7fff700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T10:29:14.677 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.684+0000 7f0ad9970ec0 20 remove_watcher() i=0 2019-11-25T10:29:14.678 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.684+0000 7f0ad9970ec0 2 removed watcher, disabling cache 2019-11-25T10:29:14.732 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.739+0000 7f0ad9970ec0 20 remove_watcher() i=1 2019-11-25T10:29:14.775 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.782+0000 7f0ad9970ec0 20 remove_watcher() i=2 2019-11-25T10:29:14.818 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.825+0000 7f0ad9970ec0 20 remove_watcher() i=3 2019-11-25T10:29:14.866 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.873+0000 7f0ad9970ec0 20 remove_watcher() i=4 2019-11-25T10:29:14.916 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.923+0000 7f0ad9970ec0 20 remove_watcher() i=5 2019-11-25T10:29:14.949 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.956+0000 7f0ad9970ec0 20 remove_watcher() i=6 2019-11-25T10:29:14.984 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T10:29:14.991+0000 7f0ad9970ec0 20 remove_watcher() i=7 2019-11-25T10:29:14.991 INFO:tasks.s3tests:Configuring s3-tests... 2019-11-25T10:29:14.992 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest/s3-tests && ./bootstrap 2019-11-25T10:29:20.756 INFO:teuthology.orchestra.run.smithi135.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-11-25T10:29:20.927 INFO:teuthology.orchestra.run.smithi135.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-11-25T10:29:20.965 INFO:teuthology.orchestra.run.smithi135.stdout:Loading mirror speeds from cached hostfile 2019-11-25T10:29:20.965 INFO:teuthology.orchestra.run.smithi135.stdout: * base: packages.oit.ncsu.edu 2019-11-25T10:29:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-11-25T10:29:20.966 INFO:teuthology.orchestra.run.smithi135.stdout: * extras: mirror.jaleco.com 2019-11-25T10:29:20.967 INFO:teuthology.orchestra.run.smithi135.stdout: * updates: mirror.atlanticmetro.net 2019-11-25T10:29:21.854 INFO:teuthology.orchestra.run.smithi135.stdout:7 packages excluded due to repository priority protections 2019-11-25T10:29:22.193 INFO:teuthology.orchestra.run.smithi135.stdout:Resolving Dependencies 2019-11-25T10:29:22.193 INFO:teuthology.orchestra.run.smithi135.stdout:--> Running transaction check 2019-11-25T10:29:22.193 INFO:teuthology.orchestra.run.smithi135.stdout:---> Package libffi-devel.x86_64 0:3.0.13-18.el7 will be installed 2019-11-25T10:29:22.589 INFO:teuthology.orchestra.run.smithi135.stdout:--> Finished Dependency Resolution 2019-11-25T10:29:22.827 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:22.827 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies Resolved 2019-11-25T10:29:22.828 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:22.828 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T10:29:22.828 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2019-11-25T10:29:22.828 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T10:29:22.828 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2019-11-25T10:29:22.828 INFO:teuthology.orchestra.run.smithi135.stdout: libffi-devel x86_64 3.0.13-18.el7 base 23 k 2019-11-25T10:29:22.829 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:22.829 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2019-11-25T10:29:22.829 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2019-11-25T10:29:22.829 INFO:teuthology.orchestra.run.smithi135.stdout:Install 1 Package 2019-11-25T10:29:22.829 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:22.829 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 23 k 2019-11-25T10:29:22.830 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 27 k 2019-11-25T10:29:22.830 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading packages: 2019-11-25T10:29:22.940 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2019-11-25T10:29:22.944 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2019-11-25T10:29:22.946 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded 2019-11-25T10:29:22.946 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2019-11-25T10:29:23.524 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-25T10:29:23.951 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-11-25T10:29:23.951 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:23.951 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2019-11-25T10:29:23.952 INFO:teuthology.orchestra.run.smithi135.stdout: libffi-devel.x86_64 0:3.0.13-18.el7 2019-11-25T10:29:23.952 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:23.952 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2019-11-25T10:29:24.117 INFO:teuthology.orchestra.run.smithi135.stdout:New python executable in /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python 2019-11-25T10:29:25.540 INFO:teuthology.orchestra.run.smithi135.stdout:Installing setuptools, pip, wheel...done. 2019-11-25T10:29:25.868 INFO:teuthology.orchestra.run.smithi135.stderr:Cache entry deserialization failed, entry ignored 2019-11-25T10:29:26.036 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting pip 2019-11-25T10:29:26.124 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-25T10:29:26.189 INFO:teuthology.orchestra.run.smithi135.stdout:Installing collected packages: pip 2019-11-25T10:29:26.189 INFO:teuthology.orchestra.run.smithi135.stdout: Found existing installation: pip 9.0.1 2019-11-25T10:29:26.256 INFO:teuthology.orchestra.run.smithi135.stdout: Uninstalling pip-9.0.1: 2019-11-25T10:29:26.299 INFO:teuthology.orchestra.run.smithi135.stdout: Successfully uninstalled pip-9.0.1 2019-11-25T10:29:26.895 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully installed pip-19.3.1 2019-11-25T10:29:27.203 INFO:teuthology.orchestra.run.smithi135.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-25T10:29:27.771 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting setuptools==32.3.1 2019-11-25T10:29:27.775 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-25T10:29:27.833 INFO:teuthology.orchestra.run.smithi135.stdout:Installing collected packages: setuptools 2019-11-25T10:29:27.834 INFO:teuthology.orchestra.run.smithi135.stdout: Found existing installation: setuptools 28.8.0 2019-11-25T10:29:27.858 INFO:teuthology.orchestra.run.smithi135.stdout: Uninstalling setuptools-28.8.0: 2019-11-25T10:29:27.872 INFO:teuthology.orchestra.run.smithi135.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-25T10:29:28.021 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully installed setuptools-32.3.1 2019-11-25T10:29:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-25T10:29:28.705 INFO:teuthology.orchestra.run.smithi135.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-25T10:29:28.783 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting nose>=1.0.0 2019-11-25T10:29:28.786 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-25T10:29:28.928 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting boto>=2.6.0 2019-11-25T10:29:28.935 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-25T10:29:29.447 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting boto3>=1.0.0 2019-11-25T10:29:29.521 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/9b/11/7e6470f5d7d7d23fc5eaae64f8a3f4b844ca08234cc3207df027267b65c4/boto3-1.10.26-py2.py3-none-any.whl (128kB) 2019-11-25T10:29:29.631 INFO:teuthology.orchestra.run.smithi135.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-25T10:29:29.888 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting gevent>=1.0 2019-11-25T10:29:29.903 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-25T10:29:30.158 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting isodate>=0.4.4 2019-11-25T10:29:30.168 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB) 2019-11-25T10:29:30.317 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting requests>=0.14.0 2019-11-25T10:29:30.328 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB) 2019-11-25T10:29:30.561 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting pytz>=2011k 2019-11-25T10:29:30.570 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB) 2019-11-25T10:29:30.772 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting ordereddict 2019-11-25T10:29:30.782 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz 2019-11-25T10:29:31.114 INFO:teuthology.orchestra.run.smithi135.stdout:Processing /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488/httplib2-0.14.0-cp27-none-any.whl 2019-11-25T10:29:31.451 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting lxml 2019-11-25T10:29:31.472 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/e4/f4/65d145cd6917131826050b0479be35aaccba2847b7f80fc4afc6bec6616b/lxml-4.4.1-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-25T10:29:31.658 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting jmespath<1.0.0,>=0.7.1 2019-11-25T10:29:31.669 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl 2019-11-25T10:29:32.227 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting botocore<1.14.0,>=1.13.26 2019-11-25T10:29:32.238 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/8a/93/ea2ec042794dfda186348df02c6057223a8bbc21c055124fbe3e16925441/botocore-1.13.26-py2.py3-none-any.whl (5.6MB) 2019-11-25T10:29:32.793 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting s3transfer<0.3.0,>=0.2.0 2019-11-25T10:29:32.803 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl (70kB) 2019-11-25T10:29:33.042 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-25T10:29:33.043 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-25T10:29:33.114 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting six 2019-11-25T10:29:33.123 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-25T10:29:33.215 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting chardet<3.1.0,>=3.0.2 2019-11-25T10:29:33.226 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 2019-11-25T10:29:33.353 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting idna<2.9,>=2.5 2019-11-25T10:29:33.362 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB) 2019-11-25T10:29:33.499 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 2019-11-25T10:29:33.508 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB) 2019-11-25T10:29:33.651 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting certifi>=2017.4.17 2019-11-25T10:29:33.661 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/18/b0/8146a4f8dd402f60744fa380bc73ca47303cccf8b9190fd16a827281eac2/certifi-2019.9.11-py2.py3-none-any.whl (154kB) 2019-11-25T10:29:33.748 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting docutils<0.16,>=0.10 2019-11-25T10:29:33.759 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/3a/dc/bf2b15d1fa15a6f7a9e77a61b74ecbbae7258558fcda8ffc9a6638a6b327/docutils-0.15.2-py2-none-any.whl (548kB) 2019-11-25T10:29:33.951 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting python-dateutil<2.8.1,>=2.1; python_version >= "2.7" 2019-11-25T10:29:33.961 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB) 2019-11-25T10:29:34.051 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" 2019-11-25T10:29:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl 2019-11-25T10:29:34.236 INFO:teuthology.orchestra.run.smithi135.stdout:Building wheels for collected packages: ordereddict 2019-11-25T10:29:34.236 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for ordereddict (setup.py): started 2019-11-25T10:29:34.354 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for ordereddict (setup.py): finished with status 'done' 2019-11-25T10:29:34.355 INFO:teuthology.orchestra.run.smithi135.stdout: Created wheel for ordereddict: filename=ordereddict-1.1-cp27-none-any.whl size=3327 sha256=31b7ffb2b60c84e13c041138cfd35b964430ef041220ff056d0e66e467076e84 2019-11-25T10:29:34.355 INFO:teuthology.orchestra.run.smithi135.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/78/d3/a8/9f52c7a389a0ffba6f575a3886b5f7a55461fb6ec34aa5fd38 2019-11-25T10:29:34.359 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully built ordereddict 2019-11-25T10:29:34.467 INFO:teuthology.orchestra.run.smithi135.stdout:Installing collected packages: PyYAML, nose, boto, jmespath, docutils, six, python-dateutil, urllib3, botocore, futures, s3transfer, boto3, bunch, greenlet, gevent, isodate, chardet, idna, certifi, requests, pytz, ordereddict, httplib2, lxml 2019-11-25T10:29:36.653 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully installed PyYAML-5.1.2 boto-2.49.0 boto3-1.10.26 botocore-1.13.26 bunch-1.0.1 certifi-2019.9.11 chardet-3.0.4 docutils-0.15.2 futures-3.3.0 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 idna-2.8 isodate-0.6.0 jmespath-0.9.4 lxml-4.4.1 nose-1.3.7 ordereddict-1.1 python-dateutil-2.8.0 pytz-2019.3 requests-2.22.0 s3transfer-0.2.1 six-1.13.0 urllib3-1.25.7 2019-11-25T10:29:36.968 INFO:teuthology.orchestra.run.smithi135.stdout:running develop 2019-11-25T10:29:37.021 INFO:teuthology.orchestra.run.smithi135.stdout:running egg_info 2019-11-25T10:29:37.021 INFO:teuthology.orchestra.run.smithi135.stdout:creating s3tests.egg-info 2019-11-25T10:29:37.022 INFO:teuthology.orchestra.run.smithi135.stdout:writing requirements to s3tests.egg-info/requires.txt 2019-11-25T10:29:37.022 INFO:teuthology.orchestra.run.smithi135.stdout:writing s3tests.egg-info/PKG-INFO 2019-11-25T10:29:37.022 INFO:teuthology.orchestra.run.smithi135.stdout:writing top-level names to s3tests.egg-info/top_level.txt 2019-11-25T10:29:37.022 INFO:teuthology.orchestra.run.smithi135.stdout:writing dependency_links to s3tests.egg-info/dependency_links.txt 2019-11-25T10:29:37.023 INFO:teuthology.orchestra.run.smithi135.stdout:writing entry points to s3tests.egg-info/entry_points.txt 2019-11-25T10:29:37.023 INFO:teuthology.orchestra.run.smithi135.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-25T10:29:37.025 INFO:teuthology.orchestra.run.smithi135.stdout:reading manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-25T10:29:37.026 INFO:teuthology.orchestra.run.smithi135.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-11-25T10:29:37.027 INFO:teuthology.orchestra.run.smithi135.stdout:running build_ext 2019-11-25T10:29:37.027 INFO:teuthology.orchestra.run.smithi135.stdout:Creating /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/s3tests.egg-link (link to .) 2019-11-25T10:29:37.028 INFO:teuthology.orchestra.run.smithi135.stdout:Adding s3tests 0.0.1 to easy-install.pth file 2019-11-25T10:29:37.030 INFO:teuthology.orchestra.run.smithi135.stdout:Installing s3tests-fuzz-headers script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-25T10:29:37.030 INFO:teuthology.orchestra.run.smithi135.stdout:Installing s3tests-generate-objects script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-25T10:29:37.030 INFO:teuthology.orchestra.run.smithi135.stdout:Installing s3tests-test-roundtrip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-25T10:29:37.031 INFO:teuthology.orchestra.run.smithi135.stdout:Installing s3tests-analysis-rwstats script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-25T10:29:37.031 INFO:teuthology.orchestra.run.smithi135.stdout:Installing s3tests-test-readwrite script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-11-25T10:29:37.031 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.032 INFO:teuthology.orchestra.run.smithi135.stdout:Installed /home/ubuntu/cephtest/s3-tests 2019-11-25T10:29:37.032 INFO:teuthology.orchestra.run.smithi135.stdout:Processing dependencies for s3tests==0.0.1 2019-11-25T10:29:37.082 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for isodate==0.6.0 2019-11-25T10:29:37.083 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: isodate 0.6.0 2019-11-25T10:29:37.083 INFO:teuthology.orchestra.run.smithi135.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-11-25T10:29:37.083 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.083 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.084 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for gevent==1.4.0 2019-11-25T10:29:37.084 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: gevent 1.4.0 2019-11-25T10:29:37.084 INFO:teuthology.orchestra.run.smithi135.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-11-25T10:29:37.084 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.084 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.086 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for bunch==1.0.1 2019-11-25T10:29:37.086 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: bunch 1.0.1 2019-11-25T10:29:37.086 INFO:teuthology.orchestra.run.smithi135.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-11-25T10:29:37.086 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.086 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.086 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for PyYAML==5.1.2 2019-11-25T10:29:37.086 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: PyYAML 5.1.2 2019-11-25T10:29:37.087 INFO:teuthology.orchestra.run.smithi135.stdout:Adding PyYAML 5.1.2 to easy-install.pth file 2019-11-25T10:29:37.087 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.087 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.088 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for boto3==1.10.26 2019-11-25T10:29:37.088 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: boto3 1.10.26 2019-11-25T10:29:37.089 INFO:teuthology.orchestra.run.smithi135.stdout:Adding boto3 1.10.26 to easy-install.pth file 2019-11-25T10:29:37.089 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.089 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.089 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for boto==2.49.0 2019-11-25T10:29:37.089 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: boto 2.49.0 2019-11-25T10:29:37.089 INFO:teuthology.orchestra.run.smithi135.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-11-25T10:29:37.089 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.090 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.090 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for six==1.13.0 2019-11-25T10:29:37.090 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: six 1.13.0 2019-11-25T10:29:37.090 INFO:teuthology.orchestra.run.smithi135.stdout:Adding six 1.13.0 to easy-install.pth file 2019-11-25T10:29:37.090 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.090 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.091 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for greenlet==0.4.15 2019-11-25T10:29:37.091 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: greenlet 0.4.15 2019-11-25T10:29:37.091 INFO:teuthology.orchestra.run.smithi135.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-11-25T10:29:37.092 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.092 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.092 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for s3transfer==0.2.1 2019-11-25T10:29:37.092 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: s3transfer 0.2.1 2019-11-25T10:29:37.095 INFO:teuthology.orchestra.run.smithi135.stdout:Adding s3transfer 0.2.1 to easy-install.pth file 2019-11-25T10:29:37.095 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.095 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.095 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for botocore==1.13.26 2019-11-25T10:29:37.095 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: botocore 1.13.26 2019-11-25T10:29:37.095 INFO:teuthology.orchestra.run.smithi135.stdout:Adding botocore 1.13.26 to easy-install.pth file 2019-11-25T10:29:37.095 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.096 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.096 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for jmespath==0.9.4 2019-11-25T10:29:37.096 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: jmespath 0.9.4 2019-11-25T10:29:37.096 INFO:teuthology.orchestra.run.smithi135.stdout:Adding jmespath 0.9.4 to easy-install.pth file 2019-11-25T10:29:37.096 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.096 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.096 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for futures==3.3.0 2019-11-25T10:29:37.098 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: futures 3.3.0 2019-11-25T10:29:37.098 INFO:teuthology.orchestra.run.smithi135.stdout:Adding futures 3.3.0 to easy-install.pth file 2019-11-25T10:29:37.098 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.098 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.099 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for urllib3==1.25.7 2019-11-25T10:29:37.099 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: urllib3 1.25.7 2019-11-25T10:29:37.099 INFO:teuthology.orchestra.run.smithi135.stdout:Adding urllib3 1.25.7 to easy-install.pth file 2019-11-25T10:29:37.099 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.099 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.099 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for python-dateutil==2.8.0 2019-11-25T10:29:37.099 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: python-dateutil 2.8.0 2019-11-25T10:29:37.099 INFO:teuthology.orchestra.run.smithi135.stdout:Adding python-dateutil 2.8.0 to easy-install.pth file 2019-11-25T10:29:37.100 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.100 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.100 INFO:teuthology.orchestra.run.smithi135.stdout:Searching for docutils==0.15.2 2019-11-25T10:29:37.101 INFO:teuthology.orchestra.run.smithi135.stdout:Best match: docutils 0.15.2 2019-11-25T10:29:37.101 INFO:teuthology.orchestra.run.smithi135.stdout:Adding docutils 0.15.2 to easy-install.pth file 2019-11-25T10:29:37.101 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T10:29:37.101 INFO:teuthology.orchestra.run.smithi135.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-11-25T10:29:37.101 INFO:teuthology.orchestra.run.smithi135.stdout:Finished processing dependencies for s3tests==0.0.1 2019-11-25T10:29:37.107 INFO:teuthology.orchestra.run.smithi135:> cat > /home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2019-11-25T10:29:37.164 INFO:tasks.s3tests:Configuring boto... 2019-11-25T10:29:37.164 INFO:teuthology.orchestra.run.smithi135:> cat > /home/ubuntu/cephtest/boto.cfg 2019-11-25T10:29:37.290 INFO:teuthology.orchestra.run.smithi135:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain' 2019-11-25T10:29:42.792 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_none ... ok 2019-11-25T10:29:45.647 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_empty ... ok 2019-11-25T10:29:48.817 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_date_and_amz_date ... ok 2019-11-25T10:29:53.143 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_amz_date_and_no_date ... ok 2019-11-25T10:29:56.214 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_none ... ok 2019-11-25T10:29:59.181 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_contentlength_none ... ok 2019-11-25T10:30:04.067 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_acl_create_contentlength_none ... ok 2019-11-25T10:30:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_contentlength_none ... ok 2019-11-25T10:30:06.301 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_empty ... ok 2019-11-25T10:30:06.768 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_none ... ok 2019-11-25T10:30:09.472 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws2 ... ok 2019-11-25T10:30:12.957 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws2 ... ok 2019-11-25T10:30:15.368 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws2 ... ok 2019-11-25T10:30:17.636 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws2 ... ok 2019-11-25T10:30:17.676 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws2 ... ok 2019-11-25T10:30:17.764 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws2 ... ok 2019-11-25T10:30:17.764 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws4 ... SKIP 2019-11-25T10:30:17.764 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws4 ... SKIP 2019-11-25T10:30:17.764 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws4 ... SKIP 2019-11-25T10:30:17.764 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-25T10:30:17.765 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_empty_aws4 ... SKIP 2019-11-25T10:30:17.765 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_none_aws4 ... SKIP 2019-11-25T10:30:17.765 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_date_invalid_aws4 ... SKIP 2019-11-25T10:30:17.765 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-25T10:30:17.765 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_date_empty_aws4 ... SKIP 2019-11-25T10:30:17.765 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-25T10:30:17.766 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws4 ... SKIP 2019-11-25T10:30:17.766 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_none_aws4 ... SKIP 2019-11-25T10:30:17.766 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_today_aws4 ... SKIP 2019-11-25T10:30:17.766 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-25T10:30:17.767 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_today_aws4 ... SKIP 2019-11-25T10:30:17.767 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-25T10:30:17.767 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-25T10:30:17.767 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-25T10:30:17.767 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_end_aws4 ... SKIP 2019-11-25T10:30:17.767 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_end_aws4 ... SKIP 2019-11-25T10:30:17.767 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_custom_header_aws4 ... SKIP 2019-11-25T10:30:17.768 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_header_aws4 ... SKIP 2019-11-25T10:30:17.768 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws4 ... SKIP 2019-11-25T10:30:17.768 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_empty_aws4 ... SKIP 2019-11-25T10:30:17.770 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_none_aws4 ... SKIP 2019-11-25T10:30:17.770 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_invalid_aws4 ... SKIP 2019-11-25T10:30:17.770 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_invalid_aws4 ... SKIP 2019-11-25T10:30:17.770 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_empty_aws4 ... SKIP 2019-11-25T10:30:17.770 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_empty_aws4 ... SKIP 2019-11-25T10:30:17.771 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws4 ... SKIP 2019-11-25T10:30:17.771 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_none_aws4 ... SKIP 2019-11-25T10:30:17.771 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_today_aws4 ... SKIP 2019-11-25T10:30:17.771 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_today_aws4 ... SKIP 2019-11-25T10:30:17.771 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_after_today_aws4 ... SKIP 2019-11-25T10:30:17.771 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_after_today_aws4 ... SKIP 2019-11-25T10:30:17.772 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws4 ... SKIP 2019-11-25T10:30:17.772 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-11-25T10:30:24.157 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_versioning_obj_read_not_exist_null ... ok 2019-11-25T10:30:24.158 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_lifecycle_transition ... SKIP 2019-11-25T10:30:24.158 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_lifecycle_transition_single_rule_multi_trans ... SKIP 2019-11-25T10:30:24.158 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_lifecycle_set_noncurrent_transition ... SKIP 2019-11-25T10:30:24.158 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_object_storage_class ... SKIP 2019-11-25T10:30:24.158 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_object_storage_class_multipart ... SKIP 2019-11-25T10:30:24.158 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_object_modify_storage_class ... SKIP 2019-11-25T10:30:24.158 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_object_modify_storage_class_multipart ... SKIP 2019-11-25T10:30:24.159 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_object_storage_class_copy ... SKIP 2019-11-25T10:30:24.159 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_object_storage_class_copy_multipart ... SKIP 2019-11-25T10:30:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok 2019-11-25T10:30:40.038 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok 2019-11-25T10:30:49.627 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_1 ... ok 2019-11-25T10:30:52.423 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_2 ... ok 2019-11-25T10:30:59.304 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_bucket_policy_set_condition_operator_end_with_IfExists ... ok 2019-11-25T10:31:05.183 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_enc ... ok 2019-11-25T10:31:08.618 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_request_obj_tag ... ok 2019-11-25T10:31:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.check_can_test_website ... SKIP 2019-11-25T10:31:16.803 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_nonexistant_bucket_rgw ... SKIP 2019-11-25T10:31:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_public_index ... SKIP 2019-11-25T10:31:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_public_index ... SKIP 2019-11-25T10:31:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty ... SKIP 2019-11-25T10:31:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty ... SKIP 2019-11-25T10:31:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index ... SKIP 2019-11-25T10:31:16.804 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index ... SKIP 2019-11-25T10:31:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_missingerrordoc ... SKIP 2019-11-25T10:31:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_missingerrordoc ... SKIP 2019-11-25T10:31:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-25T10:31:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_missingerrordoc ... SKIP 2019-11-25T10:31:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_blockederrordoc ... SKIP 2019-11-25T10:31:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_blockederrordoc ... SKIP 2019-11-25T10:31:16.805 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-25T10:31:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_blockederrordoc ... SKIP 2019-11-25T10:31:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_gooderrordoc ... SKIP 2019-11-25T10:31:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_gooderrordoc ... SKIP 2019-11-25T10:31:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-25T10:31:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_gooderrordoc ... SKIP 2019-11-25T10:31:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_base ... SKIP 2019-11-25T10:31:16.806 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path ... SKIP 2019-11-25T10:31:16.807 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path_upgrade ... SKIP 2019-11-25T10:31:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_xredirect_nonwebsite ... SKIP 2019-11-25T10:31:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_relative ... SKIP 2019-11-25T10:31:16.808 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_abs ... SKIP 2019-11-25T10:31:16.809 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_relative ... SKIP 2019-11-25T10:31:16.809 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_abs ... SKIP 2019-11-25T10:31:16.809 INFO:teuthology.orchestra.run.smithi135.stderr:SKIP 2019-11-25T10:31:16.815 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.functional.test_utils.test_generate ... ok 2019-11-25T10:32:23.576 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:07:36.730 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:32:23.622 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:07:36.776 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:32:23.624 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:07:36.873 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:32:23.635 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:07:36.885 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:32:23.644 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:07:36.799 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:32:23.650 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:07:36.804 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:32:23.741 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:07:36.991 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:32:23.816 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:07:36.969 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:32:23.821 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:07:36.975 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:33:13.136 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-25T10:33:13.136 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-25T10:33:13.136 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-25T10:33:13.136 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-25T10:33:13.137 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-25T10:33:13.137 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-25T10:33:13.138 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-25T10:33:13.601 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-25T10:33:13.799 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-25T10:33:14.134 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-25T10:33:14.157 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-25T10:33:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-25T10:33:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-25T10:33:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-25T10:33:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-25T10:33:14.176 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-25T10:33:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-25T10:33:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-25T10:33:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-25T10:33:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-25T10:33:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-25T10:33:14.177 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-25T10:33:14.181 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-25T10:33:14.181 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-25T10:33:14.181 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-25T10:33:14.181 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-25T10:33:14.186 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-25T10:33:14.187 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-25T10:33:14.187 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-25T10:33:14.187 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-25T10:33:14.210 INFO:teuthology.orchestra.run.smithi135.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-25T10:33:14.234 INFO:teuthology.orchestra.run.smithi135.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-25T10:33:14.234 INFO:teuthology.orchestra.run.smithi135.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-25T10:33:14.382 INFO:teuthology.orchestra.run.smithi135.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-25T10:33:15.521 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:08:28.675 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:33:15.523 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:08:28.677 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:33:15.538 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:08:28.692 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:33:15.540 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:08:28.789 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:33:15.544 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:08:28.698 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:33:15.545 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:08:28.795 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:33:15.585 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:08:28.738 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:33:15.608 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:08:28.762 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:33:15.616 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:08:28.866 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:33:18.312 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_short ... ok 2019-11-25T10:33:31.818 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_bad ... ok 2019-11-25T10:33:34.017 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_empty ... ok 2019-11-25T10:33:39.782 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_none ... ok 2019-11-25T10:33:46.373 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_mismatch ... ok 2019-11-25T10:33:52.650 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_empty ... ok 2019-11-25T10:34:00.118 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_none ... ok 2019-11-25T10:34:02.214 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contentlength_negative ... ok 2019-11-25T10:34:08.677 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_invalid ... ok 2019-11-25T10:34:12.923 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_empty ... ok 2019-11-25T10:34:15.778 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_none ... ok 2019-11-25T10:34:17.809 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_put_bad_canned_acl ... ok 2019-11-25T10:34:19.627 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_mismatch ... ok 2019-11-25T10:34:21.026 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_empty ... ok 2019-11-25T10:34:21.331 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_contentlength_negative ... ok 2019-11-25T10:34:24.039 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws2 ... ok 2019-11-25T10:34:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_empty_aws2 ... ok 2019-11-25T10:34:35.502 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_none_aws2 ... ok 2019-11-25T10:34:37.258 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_invalid_aws2 ... ok 2019-11-25T10:34:39.365 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_empty_aws2 ... ok 2019-11-25T10:34:42.398 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_today_aws2 ... ok 2019-11-25T10:34:44.441 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_epoch_aws2 ... ok 2019-11-25T10:34:46.823 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_after_end_aws2 ... ok 2019-11-25T10:34:48.914 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_empty_aws2 ... ok 2019-11-25T10:34:50.924 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_none_aws2 ... ok 2019-11-25T10:34:51.220 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_invalid_aws2 ... ok 2019-11-25T10:34:51.383 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_empty_aws2 ... ok 2019-11-25T10:34:51.630 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_today_aws2 ... ok 2019-11-25T10:34:51.796 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_after_today_aws2 ... ok 2019-11-25T10:34:51.860 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws2 ... ok 2019-11-25T10:34:54.565 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_empty ... ok 2019-11-25T10:35:04.446 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_distinct ... ok 2019-11-25T10:35:11.539 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_many ... ok 2019-11-25T10:35:19.839 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_many ... ok 2019-11-25T10:35:28.746 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_basic_key_count ... ok 2019-11-25T10:35:39.590 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_basic ... ok 2019-11-25T10:35:49.357 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_basic ... ok 2019-11-25T10:36:02.594 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix ... ok 2019-11-25T10:36:15.383 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix ... ok 2019-11-25T10:36:21.243 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_ends_with_delimiter ... ok 2019-11-25T10:36:25.518 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_ends_with_delimiter ... ok 2019-11-25T10:36:33.503 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_alt ... ok 2019-11-25T10:36:40.945 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_alt ... ok 2019-11-25T10:36:53.276 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_underscore ... ok 2019-11-25T10:37:04.264 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_underscore ... ok 2019-11-25T10:37:13.627 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_percentage ... ok 2019-11-25T10:37:20.648 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_percentage ... ok 2019-11-25T10:37:27.675 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_whitespace ... ok 2019-11-25T10:37:33.750 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_whitespace ... ok 2019-11-25T10:37:42.120 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_dot ... ok 2019-11-25T10:37:50.978 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_dot ... ok 2019-11-25T10:37:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_unreadable ... ok 2019-11-25T10:38:04.444 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_unreadable ... ok 2019-11-25T10:38:12.277 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_empty ... ok 2019-11-25T10:38:18.869 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_empty ... ok 2019-11-25T10:38:23.377 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_none ... ok 2019-11-25T10:38:29.643 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:13:42.796 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:38:29.650 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:13:42.803 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:38:29.661 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:13:42.813 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:38:29.664 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:13:42.817 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:38:29.673 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:13:42.923 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:38:29.691 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:13:42.941 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:38:29.820 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:13:42.973 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:38:29.879 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:13:43.032 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:38:29.982 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:13:43.232 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:38:31.556 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_none ... ok 2019-11-25T10:38:37.039 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_notempty ... ok 2019-11-25T10:38:45.527 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_defaultempty ... ok 2019-11-25T10:38:51.922 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_empty ... ok 2019-11-25T10:38:58.630 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_exist ... ok 2019-11-25T10:39:05.987 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_not_exist ... ok 2019-11-25T10:40:44.969 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:15:58.120 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:40:44.986 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:15:58.138 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:40:45.013 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:15:58.165 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:40:45.017 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:15:58.169 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:40:45.045 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:15:58.295 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:40:45.049 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:15:58.201 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:40:45.064 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:15:58.313 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:40:45.137 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:15:58.288 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:40:45.220 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:15:58.469 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:43:42.006 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:18:55.157 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:43:42.011 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:18:55.163 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:43:42.030 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:18:55.280 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:43:42.036 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:18:55.286 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:43:42.046 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:18:55.198 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:43:42.053 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:18:55.204 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:43:42.128 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:18:55.279 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:43:42.153 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:18:55.403 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:43:42.162 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:18:55.313 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:48:52.432 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:24:05.582 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:48:52.435 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:24:05.586 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:48:52.447 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:24:05.696 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:48:52.452 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:24:05.702 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:48:52.464 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:24:05.614 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:48:52.467 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:24:05.618 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:48:52.627 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:24:05.777 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:48:52.659 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:24:05.909 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:48:52.661 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:24:05.811 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:49:06.310 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:24:19.460 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:49:06.365 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:24:19.513 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:49:06.396 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:24:19.547 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:49:06.397 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:24:19.547 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:49:06.401 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:24:19.552 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:49:06.413 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:24:19.663 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:49:06.418 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:24:19.668 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:49:06.431 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:24:19.582 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:49:06.448 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:24:19.698 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:54:04.304 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:29:17.454 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:54:04.308 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:29:17.459 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:54:04.317 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:29:17.566 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:54:04.317 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:29:17.468 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:54:04.321 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:29:17.571 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:54:04.323 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:29:17.474 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:54:04.491 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:29:17.642 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:54:04.497 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:29:17.747 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:54:04.502 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:29:17.653 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:57:07.320 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_skip_special ... ok 2019-11-25T10:57:14.304 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_basic ... ok 2019-11-25T10:57:19.824 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_basic ... ok 2019-11-25T10:57:26.894 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_alt ... ok 2019-11-25T10:57:27.745 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:32:40.896 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:57:27.769 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:32:40.921 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:57:27.774 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:32:40.925 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:57:27.788 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:32:40.940 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:57:27.812 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:32:41.060 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:57:27.813 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:32:41.063 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:57:27.883 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:32:41.034 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:57:27.890 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:32:41.042 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:57:27.909 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:32:41.159 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:57:30.796 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_alt ... ok 2019-11-25T10:57:36.000 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_empty ... ok 2019-11-25T10:57:42.633 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_empty ... ok 2019-11-25T10:57:48.731 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_none ... ok 2019-11-25T10:57:55.425 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_none ... ok 2019-11-25T10:58:01.427 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_not_exist ... ok 2019-11-25T10:58:05.747 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_not_exist ... ok 2019-11-25T10:58:10.379 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_unreadable ... ok 2019-11-25T10:58:16.414 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_unreadable ... ok 2019-11-25T10:58:23.306 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_basic ... ok 2019-11-25T10:58:31.899 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_basic ... ok 2019-11-25T10:58:40.538 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_alt ... ok 2019-11-25T10:58:49.551 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_alt ... ok 2019-11-25T10:58:55.467 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_not_exist ... ok 2019-11-25T10:59:05.208 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_not_exist ... ok 2019-11-25T10:59:12.647 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_delimiter_not_exist ... ok 2019-11-25T10:59:16.683 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:34:29.835 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:59:16.689 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:34:29.841 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:59:16.702 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:34:29.854 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:59:16.706 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:34:29.858 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:59:16.711 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:34:29.961 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:59:16.720 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:34:29.970 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:59:16.768 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:34:29.919 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T10:59:16.818 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:34:29.969 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T10:59:16.864 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:34:30.113 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T10:59:20.292 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_delimiter_not_exist ... ok 2019-11-25T10:59:27.360 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-11-25T10:59:35.569 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-11-25T10:59:43.710 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_one ... ok 2019-11-25T10:59:53.631 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_one ... ok 2019-11-25T10:59:59.127 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_zero ... ok 2019-11-25T11:00:07.450 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_zero ... ok 2019-11-25T11:00:13.501 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_none ... ok 2019-11-25T11:00:22.577 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_none ... ok 2019-11-25T11:00:55.911 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_unordered ... ok 2019-11-25T11:01:34.252 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_unordered ... ok 2019-11-25T11:01:42.193 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_invalid ... ok 2019-11-25T11:01:48.851 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_none ... ok 2019-11-25T11:01:55.576 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_empty ... ok 2019-11-25T11:02:02.479 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_continuationtoken_empty ... ok 2019-11-25T11:02:10.236 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_unreadable ... ok 2019-11-25T11:02:18.075 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_unreadable ... ok 2019-11-25T11:02:25.741 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_not_in_list ... ok 2019-11-25T11:02:32.974 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_not_in_list ... ok 2019-11-25T11:02:38.454 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_after_list ... ok 2019-11-25T11:02:47.107 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_after_list ... ok 2019-11-25T11:02:55.953 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data ... ok 2019-11-25T11:03:18.752 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data_versioning ... ok 2019-11-25T11:03:22.477 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous ... ok 2019-11-25T11:03:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous ... ok 2019-11-25T11:03:30.451 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous_fail ... ok 2019-11-25T11:03:33.729 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous_fail ... ok 2019-11-25T11:03:34.583 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_notexist ... ok 2019-11-25T11:03:35.015 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_notexist ... ok 2019-11-25T11:03:35.323 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_notexist ... ok 2019-11-25T11:03:40.239 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_nonempty ... ok 2019-11-25T11:03:48.141 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_concurrent_set_canned_acl ... ok 2019-11-25T11:03:48.350 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_write_to_nonexist_bucket ... ok 2019-11-25T11:03:54.313 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_delete ... ok 2019-11-25T11:03:56.185 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_read_notexist ... ok 2019-11-25T11:03:58.664 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_requestid_matches_header_on_error ... ok 2019-11-25T11:04:10.530 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multi_object_delete ... ok 2019-11-25T11:04:24.963 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multi_objectv2_delete ... ok 2019-11-25T11:04:28.539 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_head_zero_bytes ... ok 2019-11-25T11:04:29.005 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:39:42.158 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:04:29.030 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:39:42.184 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:04:29.056 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:39:42.306 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:04:29.060 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:39:42.309 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:04:29.092 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:39:42.245 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:04:29.098 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:39:42.251 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:04:29.249 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:39:42.389 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:04:29.275 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:39:42.516 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:04:29.290 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:39:42.426 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:04:30.116 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_write_check_etag ... ok 2019-11-25T11:04:33.276 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_write_cache_control ... ok 2019-11-25T11:04:38.977 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_write_expires ... ok 2019-11-25T11:04:44.371 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_write_read_update_read_delete ... ok 2019-11-25T11:04:50.428 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_good ... ok 2019-11-25T11:04:55.702 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_empty ... ok 2019-11-25T11:05:01.328 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_overwrite_to_empty ... ok 2019-11-25T11:05:05.819 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_unicode_metadata ... ok 2019-11-25T11:05:13.122 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_metadata_replaced_on_put ... ok 2019-11-25T11:05:17.294 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_write_file ... ok 2019-11-25T11:05:23.381 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_anonymous_request ... ok 2019-11-25T11:05:29.030 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request ... ok 2019-11-25T11:05:31.991 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_no_content_type ... ok 2019-11-25T11:05:34.413 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request_bad_access_key ... ok 2019-11-25T11:05:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_success_code ... ok 2019-11-25T11:05:43.530 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_invalid_success_code ... ok 2019-11-25T11:05:49.285 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:41:02.438 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:05:49.306 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:41:02.459 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:05:49.329 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:41:02.579 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:05:49.331 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:41:02.581 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:05:49.347 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:41:02.499 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:05:49.349 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:41:02.501 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:05:49.369 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_larger_than_chunk ... ok 2019-11-25T11:05:49.377 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:41:02.529 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:05:49.387 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:41:02.637 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:05:49.418 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:41:02.557 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:05:53.593 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_key_from_filename ... ok 2019-11-25T11:05:57.450 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_ignored_header ... ok 2019-11-25T11:06:02.005 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_case_insensitive_condition_fields ... ok 2019-11-25T11:06:05.288 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_escaped_field_values ... ok 2019-11-25T11:06:12.128 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_success_redirect_action ... ok 2019-11-25T11:06:16.325 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_signature ... ok 2019-11-25T11:06:19.338 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_access_key ... ok 2019-11-25T11:06:21.615 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_date_format ... ok 2019-11-25T11:06:24.648 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:41:37.801 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:06:24.684 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:41:37.837 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:06:24.700 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:41:37.853 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:06:24.703 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:41:37.855 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:06:24.725 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:41:37.878 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:06:24.737 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:41:37.987 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:06:24.746 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:41:37.991 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:06:24.749 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:41:37.901 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:06:24.800 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_no_key_specified ... ok 2019-11-25T11:06:24.813 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:41:38.063 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:06:27.822 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_signature ... ok 2019-11-25T11:06:32.127 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_policy_condition ... ok 2019-11-25T11:06:35.051 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_user_specified_header ... ok 2019-11-25T11:06:36.543 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_request_missing_policy_specified_field ... ok 2019-11-25T11:06:38.911 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_condition_is_case_sensitive ... ok 2019-11-25T11:06:43.221 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_expires_is_case_sensitive ... ok 2019-11-25T11:06:47.129 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_expired_policy ... ok 2019-11-25T11:06:49.642 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_request_field_value ... ok 2019-11-25T11:06:51.153 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_expires_condition ... ok 2019-11-25T11:06:53.001 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_conditions_list ... ok 2019-11-25T11:06:55.412 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_limit_exceeded ... ok 2019-11-25T11:06:57.278 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_content_length_argument ... ok 2019-11-25T11:06:59.422 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_content_length_argument ... ok 2019-11-25T11:07:02.251 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_below_minimum ... ok 2019-11-25T11:07:05.633 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_empty_conditions ... ok 2019-11-25T11:07:08.202 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_good ... ok 2019-11-25T11:07:11.081 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_failed ... ok 2019-11-25T11:07:14.227 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_good ... ok 2019-11-25T11:07:17.725 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_failed ... ok 2019-11-25T11:07:21.633 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_good ... ok 2019-11-25T11:07:24.897 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_failed ... ok 2019-11-25T11:07:29.202 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_good ... ok 2019-11-25T11:07:33.269 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_failed ... ok 2019-11-25T11:07:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_good ... ok 2019-11-25T11:07:42.979 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_failed ... ok 2019-11-25T11:07:48.471 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_overwrite_existed_good ... ok 2019-11-25T11:07:52.211 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_nonexisted_failed ... ok 2019-11-25T11:07:56.695 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_good ... ok 2019-11-25T11:08:01.224 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_failed ... ok 2019-11-25T11:08:05.025 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_nonexisted_good ... ok 2019-11-25T11:08:10.236 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_overwrite_existed_failed ... ok 2019-11-25T11:08:13.199 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get ... ok 2019-11-25T11:08:23.919 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_gone ... ok 2019-11-25T11:08:32.706 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_delete_key_bucket_gone ... ok 2019-11-25T11:08:40.073 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_gone ... ok 2019-11-25T11:08:42.674 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_head ... ok 2019-11-25T11:08:53.012 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_head_extended ... ok 2019-11-25T11:08:57.671 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_acl ... ok 2019-11-25T11:09:00.352 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_acl ... ok 2019-11-25T11:09:03.596 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated ... ok 2019-11-25T11:09:07.968 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_response_headers ... ok 2019-11-25T11:09:12.230 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_acl ... ok 2019-11-25T11:09:16.002 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_acl ... ok 2019-11-25T11:09:27.183 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_gone ... ok 2019-11-25T11:09:31.193 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_gone ... ok 2019-11-25T11:09:34.813 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_not_expired ... ok 2019-11-25T11:09:39.391 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:44:52.542 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:09:39.398 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:44:52.549 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:09:39.425 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:44:52.675 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:09:39.432 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:44:52.682 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:09:39.435 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:44:52.587 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:09:39.437 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:44:52.589 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:09:39.519 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_range_zero ... ok 2019-11-25T11:09:39.536 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:44:52.687 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:09:39.582 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:44:52.826 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:09:39.596 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:44:52.748 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:09:42.478 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_max_range ... ok 2019-11-25T11:09:47.119 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_positive_range ... ok 2019-11-25T11:09:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put ... ok 2019-11-25T11:09:58.003 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put_write_access ... ok 2019-11-25T11:10:02.023 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_put_authenticated ... ok 2019-11-25T11:10:04.982 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_raw_put_authenticated_expired ... ok 2019-11-25T11:10:05.555 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_one ... ok 2019-11-25T11:10:06.078 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_two ... ok 2019-11-25T11:10:06.963 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_ip ... ok 2019-11-25T11:10:07.571 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_dns_underscore ... ok 2019-11-25T11:10:12.238 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists ... ok 2019-11-25T11:10:15.554 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_get_location ... ok 2019-11-25T11:10:20.152 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists_nonowner ... ok 2019-11-25T11:10:21.917 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_default ... ok 2019-11-25T11:10:23.643 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_during_create ... ok 2019-11-25T11:10:27.150 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned ... ok 2019-11-25T11:10:29.683 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_publicreadwrite ... ok 2019-11-25T11:10:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_authenticatedread ... ok 2019-11-25T11:10:35.370 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_default ... ok 2019-11-25T11:10:39.426 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_during_create ... ok 2019-11-25T11:10:45.308 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned ... ok 2019-11-25T11:10:49.859 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_publicreadwrite ... ok 2019-11-25T11:10:52.438 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_authenticatedread ... ok 2019-11-25T11:11:01.185 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerread ... ok 2019-11-25T11:11:07.221 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerfullcontrol ... ok 2019-11-25T11:11:13.627 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_owner ... ok 2019-11-25T11:11:19.112 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_attributes ... ok 2019-11-25T11:11:22.233 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_private_to_private ... ok 2019-11-25T11:11:27.759 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl ... ok 2019-11-25T11:11:33.120 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_write ... ok 2019-11-25T11:11:38.998 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_writeacp ... ok 2019-11-25T11:11:43.949 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_read ... ok 2019-11-25T11:11:50.121 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_acl_readacp ... ok 2019-11-25T11:11:57.016 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_fullcontrol ... ok 2019-11-25T11:12:01.902 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_read ... ok 2019-11-25T11:12:08.199 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_readacp ... ok 2019-11-25T11:12:13.315 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_write ... ok 2019-11-25T11:12:19.339 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_writeacp ... ok 2019-11-25T11:12:22.868 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_nonexist_user ... ok 2019-11-25T11:12:28.699 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_no_grants ... ok 2019-11-25T11:12:32.937 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_header_acl_grants ... ok 2019-11-25T11:12:39.376 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_header_acl_grants ... ok 2019-11-25T11:12:43.873 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email ... ok 2019-11-25T11:12:46.450 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email_notexist ... ok 2019-11-25T11:12:52.821 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_revoke_all ... ok 2019-11-25T11:13:02.373 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_private ... ok 2019-11-25T11:13:12.212 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_private ... ok 2019-11-25T11:13:19.031 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicread ... ok 2019-11-25T11:13:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicread ... ok 2019-11-25T11:13:39.326 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicreadwrite ... ok 2019-11-25T11:13:49.015 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicreadwrite ... ok 2019-11-25T11:14:00.468 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_private ... ok 2019-11-25T11:14:08.918 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicread ... ok 2019-11-25T11:14:11.180 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:49:24.330 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:11.189 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:49:24.339 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:11.219 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:49:24.367 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:11.237 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:49:24.388 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:11.244 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:49:24.491 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:11.251 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:49:24.495 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:11.318 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:49:24.468 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:11.367 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:49:24.615 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:11.411 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:49:24.562 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:19.186 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicreadwrite ... ok 2019-11-25T11:14:30.710 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_private ... ok 2019-11-25T11:14:42.660 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicread ... ok 2019-11-25T11:14:51.371 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:50:04.521 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:51.376 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:50:04.527 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:51.403 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:50:04.553 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:51.403 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:50:04.652 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:51.407 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:50:04.557 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:51.410 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:50:04.659 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:51.455 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:50:04.705 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:51.458 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:50:04.608 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:51.459 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:50:04.610 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:14:55.080 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicreadwrite ... ok 2019-11-25T11:15:09.220 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_buckets_create_then_list ... ok 2019-11-25T11:15:09.870 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_anonymous ... ok 2019-11-25T11:15:10.358 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_invalid_auth ... ok 2019-11-25T11:15:10.432 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_bad_auth ... ok 2019-11-25T11:15:22.525 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... ok 2019-11-25T11:15:33.319 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_digit ... ok 2019-11-25T11:15:36.895 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_period ... ok 2019-11-25T11:15:38.838 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... ok 2019-11-25T11:15:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_recreate_not_overriding ... ok 2019-11-25T11:16:26.392 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_special_key_names ... ok 2019-11-25T11:16:35.725 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_special_prefix ... ok 2019-11-25T11:16:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_zero_size ... ok 2019-11-25T11:16:49.407 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_same_bucket ... ok 2019-11-25T11:16:54.138 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_verify_contenttype ... ok 2019-11-25T11:16:58.220 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself ... ok 2019-11-25T11:17:01.827 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself_with_metadata ... ok 2019-11-25T11:17:09.758 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_diff_bucket ... ok 2019-11-25T11:17:15.007 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_bucket ... ok 2019-11-25T11:17:22.452 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_object_bucket ... ok 2019-11-25T11:17:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_canned_acl ... ok 2019-11-25T11:17:41.837 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_retaining_metadata ... ok 2019-11-25T11:17:51.476 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_replacing_metadata ... ok 2019-11-25T11:17:53.572 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_bucket_not_found ... ok 2019-11-25T11:17:57.351 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_key_not_found ... ok 2019-11-25T11:18:29.868 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_bucket ... ok 2019-11-25T11:18:42.198 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... ok 2019-11-25T11:19:24.297 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:19:24.146+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:19:57.275 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... ok 2019-11-25T11:20:02.051 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_empty ... ok 2019-11-25T11:20:02.893 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:55:16.043 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:20:02.900 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:55:16.050 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:20:02.912 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:55:16.060 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:20:02.917 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:55:16.167 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:20:02.922 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:55:16.072 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:20:02.947 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:55:16.196 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:20:03.097 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:55:16.247 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:20:03.113 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:55:16.263 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:20:03.177 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:55:16.426 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:20:11.367 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_small ... ok 2019-11-25T11:20:30.641 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:20:30.618+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:20:31.667 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_small ... ok 2019-11-25T11:20:39.815 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_invalid_range ... ok 2019-11-25T11:20:55.927 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_without_range ... ok 2019-11-25T11:21:14.538 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:21:14.530+0000 4025e700 -1 handle_data failed with exit code -5 2019-11-25T11:21:30.134 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:21:30.037+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:22:01.855 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:22:01.645+0000 4025e700 -1 handle_data failed with exit code -5 2019-11-25T11:22:02.311 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_special_names ... ok 2019-11-25T11:22:32.615 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:57:45.765 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:22:32.648 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:57:45.798 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:22:32.653 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:57:45.803 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:22:32.671 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:57:45.821 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:22:32.698 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:57:45.948 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:22:32.706 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:57:45.956 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:22:32.738 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:01:57:45.888 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:22:32.774 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:01:57:45.925 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:22:32.816 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:01:57:46.066 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:22:37.990 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:22:37.937+0000 4025e700 -1 handle_data failed with exit code -5 2019-11-25T11:23:13.062 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:23:13.040+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:23:16.896 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload ... ok 2019-11-25T11:24:11.235 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:24:11.226+0000 4025e700 -1 handle_data failed with exit code -5 2019-11-25T11:24:29.061 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:24:29.045+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:24:32.042 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:24:31.958+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:24:53.249 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:24:53.133+0000 4025e700 -1 handle_data failed with exit code -5 2019-11-25T11:24:59.896 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_versioned ... ok 2019-11-25T11:24:59.956 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:24:59.907+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:25:13.264 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:00:26.414 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:25:13.268 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:00:26.418 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:25:13.277 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:00:26.427 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:25:13.281 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:00:26.432 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:25:13.290 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:00:26.540 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:25:13.295 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:00:26.545 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:25:13.398 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:00:26.549 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:25:13.446 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:00:26.596 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:25:13.451 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:00:26.701 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:26:58.028 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:26:57.990+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:27:22.700 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:27:22.656+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:29:25.656 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:29:25.628+0000 4025e700 -1 handle_data failed with exit code -5 2019-11-25T11:30:03.447 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:30:03.420+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:30:25.114 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:05:38.266 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:25.127 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:05:38.278 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:25.139 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:05:38.291 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:25.143 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:05:38.295 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:25.144 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:05:38.394 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:25.148 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:05:38.398 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:25.368 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:05:38.519 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:25.375 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:05:38.527 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:25.396 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:05:38.646 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:54.202 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:06:07.354 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:54.223 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:06:07.375 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:54.257 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:06:07.507 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:54.259 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:06:07.509 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:54.273 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:06:07.424 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:54.276 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:06:07.427 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:54.288 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:06:07.440 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:54.298 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:06:07.548 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:54.308 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:06:07.460 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:30:57.373 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:30:57.368+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:31:25.745 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:31:25.578+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:31:28.791 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_resend_part ... ok 2019-11-25T11:32:43.925 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_multiple_sizes ... ok 2019-11-25T11:33:04.301 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:33:04.281+0000 4025e700 -1 handle_data failed with exit code -5 2019-11-25T11:33:17.495 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:33:17.463+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:33:33.538 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:33:33.479+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:33:53.709 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:33:53.696+0000 4025e700 -1 handle_data failed with exit code -5 2019-11-25T11:34:12.280 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:34:12.164+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:34:28.293 INFO:tasks.rgw.client.0.smithi135.stdout:2019-11-25T11:34:28.269+0000 3fa5d700 -1 handle_data failed with exit code -5 2019-11-25T11:34:28.914 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_multiple_sizes ... ok 2019-11-25T11:34:59.246 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_size_too_small ... ok 2019-11-25T11:35:26.840 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_contents ... ok 2019-11-25T11:35:34.497 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:10:47.649 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:35:34.504 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:10:47.656 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:35:34.516 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:10:47.665 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:35:34.516 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:10:47.668 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:35:34.528 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:10:47.776 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:35:34.542 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:10:47.792 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:35:34.684 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:10:47.835 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:35:34.700 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:10:47.843 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:35:34.760 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:10:48.009 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:35:42.643 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_overwrite_existing_object ... ok 2019-11-25T11:35:58.383 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload ... ok 2019-11-25T11:36:02.554 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload_not_found ... ok 2019-11-25T11:36:29.885 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload ... ok 2019-11-25T11:36:39.388 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_missing_part ... ok 2019-11-25T11:36:45.127 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_incorrect_etag ... ok 2019-11-25T11:36:49.717 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_100_continue ... ok 2019-11-25T11:36:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_set_cors ... ok 2019-11-25T11:37:17.879 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_response ... ok 2019-11-25T11:37:24.433 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_wildcard ... ok 2019-11-25T11:37:31.439 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_cors_header_option ... ok 2019-11-25T11:37:38.393 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_1mb ... ok 2019-11-25T11:37:48.079 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_4mb ... ok 2019-11-25T11:38:02.098 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_8mb ... ok 2019-11-25T11:38:10.713 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_1mb ... ok 2019-11-25T11:38:22.802 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_4mb ... ok 2019-11-25T11:38:38.848 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_8mb ... ok 2019-11-25T11:38:52.064 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_1mb ... ok 2019-11-25T11:39:08.223 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_4mb ... ok 2019-11-25T11:39:15.684 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:14:28.834 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:39:15.712 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:14:28.863 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:39:15.730 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:14:28.881 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:39:15.731 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:14:28.882 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:39:15.777 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:14:29.026 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:39:15.779 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:14:29.029 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:39:15.814 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:14:28.965 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:39:15.822 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:14:28.973 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:39:15.883 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:14:29.133 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:39:30.764 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_8mb ... ok 2019-11-25T11:39:41.080 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_conditional_write_1mb ... ok 2019-11-25T11:39:49.616 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_atomic_multipart_upload_write ... ok 2019-11-25T11:40:11.418 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_multipart_resend_first_finishes_last ... ok 2019-11-25T11:40:14.589 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_response_code ... ok 2019-11-25T11:40:29.057 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_ranged_big_request_response_code ... ok 2019-11-25T11:40:33.725 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_skip_leading_bytes_response_code ... ok 2019-11-25T11:40:39.403 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_return_trailing_bytes_response_code ... ok 2019-11-25T11:40:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_invalid_range ... ok 2019-11-25T11:40:46.014 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:15:59.165 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:40:46.018 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:15:59.169 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:40:46.026 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:15:59.276 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:40:46.027 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:15:59.178 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:40:46.031 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:15:59.281 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:40:46.031 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:15:59.182 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:40:46.090 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:15:59.240 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:40:46.101 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:15:59.252 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:40:46.105 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:15:59.355 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:40:46.714 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_empty_object ... ok 2019-11-25T11:40:54.879 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_create_suspend ... ok 2019-11-25T11:45:56.952 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:21:10.103 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:45:56.958 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:21:10.109 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:45:56.967 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:21:10.118 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:45:56.968 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:21:10.218 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:45:56.972 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:21:10.222 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:45:56.974 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:21:10.124 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:45:57.138 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:21:10.289 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:45:57.145 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:21:10.296 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:45:57.169 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:21:10.420 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:46:37.050 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove ... ok 2019-11-25T11:47:07.224 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:22:20.375 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:07.240 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:22:20.391 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:07.278 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:22:20.429 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:07.287 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:22:20.438 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:07.299 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:22:20.548 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:07.301 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:22:20.551 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:07.344 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:22:20.494 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:07.365 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:22:20.516 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:07.390 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:22:20.640 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:25.989 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove_head ... ok 2019-11-25T11:47:36.628 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_removal ... ok 2019-11-25T11:47:37.376 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:22:50.527 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:37.398 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:22:50.549 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:37.408 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:22:50.558 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:37.424 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:22:50.573 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:37.434 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:22:50.585 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:37.434 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:22:50.684 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:37.443 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:22:50.693 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:37.464 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:22:50.614 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:37.497 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:22:50.747 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:47:54.785 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite ... ok 2019-11-25T11:48:08.959 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite_suspended ... ok 2019-11-25T11:50:05.419 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_suspend_versions ... ok 2019-11-25T11:51:03.191 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:26:16.342 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:51:03.197 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:26:16.348 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:51:03.205 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:26:16.357 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:51:03.210 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:26:16.361 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:51:03.215 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:26:16.463 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:51:03.220 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:26:16.471 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:51:03.331 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:26:16.482 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:51:03.338 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:26:16.489 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:51:03.368 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:26:16.618 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:52:10.421 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_all ... ok 2019-11-25T11:55:58.794 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:31:11.945 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:55:58.818 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:31:11.969 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:55:58.836 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:31:12.086 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:55:58.850 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:31:12.002 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:55:58.853 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:31:12.005 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:55:58.896 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:31:12.147 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:55:58.987 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:31:12.138 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:55:59.025 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:31:12.176 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:55:59.040 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:31:12.290 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:56:15.261 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:31:28.413 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:56:15.265 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:31:28.417 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:56:15.288 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:31:28.538 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:56:15.294 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:31:28.445 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T11:56:15.296 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:31:28.547 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:56:15.302 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:31:28.453 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:56:15.305 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:31:28.456 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:56:15.339 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:31:28.491 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T11:56:15.355 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:31:28.606 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T11:59:45.055 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_special_names ... ok 2019-11-25T12:01:25.849 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:36:39.000 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:01:25.861 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:36:39.012 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:01:25.864 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:36:39.115 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:01:25.865 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:36:39.017 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:01:25.869 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:36:39.119 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:01:25.872 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:36:39.024 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:01:26.044 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:36:39.195 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:01:26.066 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:36:39.317 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:01:26.121 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:36:39.273 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:01:32.751 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... ok 2019-11-25T12:02:16.762 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_list_marker ... ok 2019-11-25T12:02:57.843 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_copy_obj_version ... ok 2019-11-25T12:03:24.655 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete ... ok 2019-11-25T12:03:56.192 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker ... ok 2019-11-25T12:04:02.890 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... ok 2019-11-25T12:04:20.197 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:39:33.348 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:04:20.228 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:39:33.379 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:04:20.241 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:39:33.393 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:04:20.243 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:39:33.394 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:04:20.261 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:39:33.511 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:04:20.266 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:39:33.517 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:04:20.302 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:39:33.454 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:04:20.321 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:39:33.473 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:04:20.393 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:39:33.644 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:04:25.281 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl ... ok 2019-11-25T12:04:46.625 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl_no_version_specified ... ok 2019-11-25T12:06:32.432 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... ok 2019-11-25T12:06:37.789 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:41:50.941 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:06:37.797 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:41:50.948 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:06:37.804 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:41:51.054 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:06:37.808 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:41:51.058 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:06:37.809 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:41:50.961 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:06:37.813 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:41:50.965 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:06:37.906 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:41:51.058 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:06:37.907 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:41:51.058 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:06:37.941 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:41:51.192 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:07:07.675 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... ok 2019-11-25T12:07:10.576 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set ... ok 2019-11-25T12:07:15.796 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get ... ok 2019-11-25T12:07:21.140 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get_no_id ... ok 2019-11-25T12:07:22.929 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_id_too_long ... ok 2019-11-25T12:07:24.280 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_same_id ... ok 2019-11-25T12:07:26.057 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_invalid_status ... ok 2019-11-25T12:07:30.419 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_date ... ok 2019-11-25T12:07:33.150 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_invalid_date ... ok 2019-11-25T12:07:39.422 INFO:teuthology.orchestra.run.smithi135.stderr:Check for valid x-amz-expiration header after PUT ... ok 2019-11-25T12:07:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:Check for valid x-amz-expiration header on HEAD request ... ok 2019-11-25T12:07:50.596 INFO:teuthology.orchestra.run.smithi135.stderr:Check for valid x-amz-expiration header on GET request ... ok 2019-11-25T12:07:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:Check x-amz-expiration-header object tags interaction ... ok 2019-11-25T12:08:05.439 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_noncurrent ... ok 2019-11-25T12:08:09.826 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_deletemarker ... ok 2019-11-25T12:08:12.979 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_filter ... ok 2019-11-25T12:08:16.043 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_empty_filter ... ok 2019-11-25T12:08:21.340 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_multipart ... ok 2019-11-25T12:08:27.573 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1b ... ok 2019-11-25T12:08:30.879 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1kb ... ok 2019-11-25T12:08:35.834 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1MB ... ok 2019-11-25T12:08:40.695 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_13b ... ok 2019-11-25T12:08:44.901 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_method_head ... ok 2019-11-25T12:08:48.452 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_present ... ok 2019-11-25T12:08:52.909 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_other_key ... ok 2019-11-25T12:08:56.299 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_invalid_md5 ... ok 2019-11-25T12:09:00.298 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_md5 ... ok 2019-11-25T12:09:02.204 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_key ... ok 2019-11-25T12:09:04.521 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encryption_key_no_sse_c ... ok 2019-11-25T12:10:31.083 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_upload ... ok 2019-11-25T12:11:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_bad_download ... ok 2019-11-25T12:11:19.104 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_post_object_authenticated_request ... ok 2019-11-25T12:11:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_method_head ... ok 2019-11-25T12:11:28.681 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_present ... ok 2019-11-25T12:11:30.840 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_no_key ... ok 2019-11-25T12:11:33.783 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_not_declared ... ok 2019-11-25T12:11:50.015 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:47:03.166 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:11:50.028 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:47:03.179 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:11:50.031 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:47:03.183 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:11:50.034 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:47:03.185 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:11:50.045 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:47:03.295 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:11:50.052 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:47:03.302 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:11:50.221 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:47:03.373 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:11:50.245 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:47:03.397 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:11:50.296 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:47:03.546 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:12:46.609 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:47:59.760 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:12:46.635 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:47:59.786 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:12:46.653 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:47:59.804 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:12:46.654 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:47:59.806 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:12:46.658 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:47:59.909 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:12:46.661 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:47:59.911 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:12:46.672 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:47:59.823 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:12:46.705 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:47:59.856 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:12:46.726 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:47:59.976 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:13:08.121 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_upload ... ok 2019-11-25T12:13:39.533 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_1 ... ok 2019-11-25T12:14:12.529 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_2 ... ok 2019-11-25T12:14:16.690 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_post_object_authenticated_request ... ok 2019-11-25T12:14:20.342 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1b ... ok 2019-11-25T12:14:26.461 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1kb ... ok 2019-11-25T12:14:32.233 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1MB ... ok 2019-11-25T12:14:36.354 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_13b ... ok 2019-11-25T12:14:39.909 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_read_declare ... ok 2019-11-25T12:14:48.042 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy ... ok 2019-11-25T12:14:53.341 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy ... ok 2019-11-25T12:15:00.933 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_acl ... ok 2019-11-25T12:15:09.142 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_acl ... ok 2019-11-25T12:15:19.859 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_another_bucket ... ok 2019-11-25T12:15:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_another_bucket ... ok 2019-11-25T12:15:37.981 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_obj_tagging ... ok 2019-11-25T12:15:44.022 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_obj_head_tagging ... ok 2019-11-25T12:15:52.117 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_max_tags ... ok 2019-11-25T12:15:59.848 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_excess_tags ... ok 2019-11-25T12:16:08.420 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_max_kvsize_tags ... ok 2019-11-25T12:16:15.890 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_excess_key_tags ... ok 2019-11-25T12:16:21.546 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_excess_val_tags ... ok 2019-11-25T12:16:30.467 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_modify_tags ... ok 2019-11-25T12:16:39.432 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_delete_tags ... ok 2019-11-25T12:16:44.861 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_anonymous_request ... ok 2019-11-25T12:16:49.699 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_authenticated_request ... ok 2019-11-25T12:16:54.850 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_obj_with_tags ... ok 2019-11-25T12:17:01.606 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_get_tags_acl_public ... ok 2019-11-25T12:17:02.173 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:52:15.324 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:17:02.180 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:52:15.331 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:17:02.187 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:52:15.338 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:17:02.191 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:52:15.342 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:17:02.200 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:52:15.450 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:17:02.213 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:52:15.464 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:17:02.348 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:52:15.499 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:17:02.354 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:52:15.505 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:17:02.381 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:52:15.631 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:17:10.149 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_put_tags_acl_public ... ok 2019-11-25T12:17:17.741 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_delete_tags_obj_public ... ok 2019-11-25T12:17:32.499 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_atomic_upload_return_version_id ... ok 2019-11-25T12:19:10.739 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id ... ok 2019-11-25T12:19:23.963 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_existing_tag ... ok 2019-11-25T12:19:35.946 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_tagging_existing_tag ... ok 2019-11-25T12:19:47.047 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_tagging_existing_tag ... ok 2019-11-25T12:20:03.232 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source ... ok 2019-11-25T12:20:18.709 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source_meta ... ok 2019-11-25T12:20:25.132 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_acl ... ok 2019-11-25T12:20:36.495 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_grant ... ok 2019-11-25T12:20:47.802 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_acl_existing_tag ... ok 2019-11-25T12:20:53.763 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock ... ok 2019-11-25T12:20:56.424 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_bucket ... ok 2019-11-25T12:20:59.854 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_with_days_and_years ... ok 2019-11-25T12:21:01.781 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_days ... ok 2019-11-25T12:21:03.899 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_years ... ok 2019-11-25T12:21:07.287 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_status ... ok 2019-11-25T12:21:08.352 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:56:21.503 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:21:08.375 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:56:21.526 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:21:08.380 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:56:21.531 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:21:08.381 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:56:21.532 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:21:08.418 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:56:21.668 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:21:08.430 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:56:21.680 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:21:08.483 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:56:21.634 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:21:08.534 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:56:21.685 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:21:08.614 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:56:21.864 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:21:09.834 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_suspend_versioning ... ok 2019-11-25T12:21:13.692 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock ... ok 2019-11-25T12:21:16.005 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock_invalid_bucket ... ok 2019-11-25T12:21:30.527 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention ... ok 2019-11-25T12:21:33.387 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_bucket ... ok 2019-11-25T12:21:40.654 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_mode ... ok 2019-11-25T12:21:56.000 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention ... ok 2019-11-25T12:22:00.549 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention_invalid_bucket ... ok 2019-11-25T12:22:12.317 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:57:25.468 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:22:12.322 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:57:25.473 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:22:12.340 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:57:25.491 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:22:12.345 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:57:25.497 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:22:12.392 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:57:25.642 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:22:12.397 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:02:57:25.548 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:22:12.398 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:57:25.647 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:22:12.427 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:02:57:25.579 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:22:12.495 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:02:57:25.745 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:22:14.136 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_versionid ... ok 2019-11-25T12:22:29.931 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_override_default_retention ... ok 2019-11-25T12:22:43.690 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_increase_period ... ok 2019-11-25T12:22:56.690 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period ... ok 2019-11-25T12:23:10.742 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period_bypass ... ok 2019-11-25T12:23:25.891 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_retention ... ok 2019-11-25T12:23:37.123 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold ... ok 2019-11-25T12:23:41.902 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_bucket ... ok 2019-11-25T12:23:48.730 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_status ... ok 2019-11-25T12:24:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold ... ok 2019-11-25T12:24:05.881 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold_invalid_bucket ... ok 2019-11-25T12:24:15.681 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_on ... ok 2019-11-25T12:24:30.342 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_off ... ok 2019-11-25T12:24:46.762 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_metadata ... ok 2019-11-25T12:25:00.668 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_s3.test_object_lock_uploading_obj ... ok 2019-11-25T12:25:00.688 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.functional.test_utils.test_generate ... ok 2019-11-25T12:27:14.730 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:02:27.881 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:14.797 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:02:27.948 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:14.803 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:02:27.954 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:14.824 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:02:27.975 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:14.838 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:02:28.088 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:14.845 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:02:28.095 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:14.987 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:02:28.138 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:15.103 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:02:28.254 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:15.167 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:02:28.417 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:20.775 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:02:33.927 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:20.784 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:02:33.936 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:20.794 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:02:33.945 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:20.798 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:02:34.048 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:20.799 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:02:33.950 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:20.803 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:02:34.054 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:20.805 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:02:33.956 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:20.826 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:02:33.978 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:27:20.837 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:02:34.087 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:29:30.082 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:04:43.234 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:29:30.133 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:04:43.284 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:29:30.167 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:04:43.316 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:29:30.175 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:04:43.326 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:29:30.178 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:04:43.428 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:29:30.194 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:04:43.346 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:29:30.206 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:04:43.456 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:29:30.238 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:04:43.390 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:29:30.307 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:04:43.558 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:32:32.768 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:07:45.919 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:32:32.775 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:07:45.927 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:32:32.783 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:07:45.934 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:32:32.785 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:07:46.036 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:32:32.787 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:07:45.938 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:32:32.793 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:07:46.043 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:32:32.904 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:07:46.056 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:32:32.933 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:07:46.183 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:32:32.968 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:07:46.119 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:46.600 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:12:59.751 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:46.609 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:12:59.760 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:46.614 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:12:59.766 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:46.627 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:12:59.873 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:46.627 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:12:59.773 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:46.636 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:12:59.880 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:46.797 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:12:59.948 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:46.863 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:13:00.114 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:46.889 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:13:00.040 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:51.647 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:13:04.798 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:51.651 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:13:04.802 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:51.670 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:13:04.821 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:51.680 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:13:04.930 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:51.692 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:13:04.942 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:51.721 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:13:04.872 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:51.723 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:13:04.875 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:51.727 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:13:04.977 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:37:51.740 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:13:04.891 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:42:57.274 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:18:10.425 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:42:57.284 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:18:10.435 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:42:57.289 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:18:10.441 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:42:57.295 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:18:10.447 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:42:57.303 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:18:10.553 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:42:57.317 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:18:10.568 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:42:57.471 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:18:10.623 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:42:57.480 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:18:10.632 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:42:57.573 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:18:10.823 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:46:13.413 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:21:26.562 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:46:13.436 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:21:26.588 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:46:13.441 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:21:26.593 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:46:13.446 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:21:26.598 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:46:13.485 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:21:26.735 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:46:13.491 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:21:26.741 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:46:13.602 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:21:26.752 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:46:13.602 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:21:26.753 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:46:13.630 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:21:26.881 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:48:08.866 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:23:22.018 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:48:08.887 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:23:22.039 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:48:08.902 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:23:22.054 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:48:08.906 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:23:22.058 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:48:08.919 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:23:22.170 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:48:08.922 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:23:22.173 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:48:08.963 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:23:22.114 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:48:08.987 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:23:22.139 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:48:09.008 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:23:22.258 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:53:21.785 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:28:34.937 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:53:21.810 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:28:34.963 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:53:21.823 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:28:34.976 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:53:21.832 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:28:35.082 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:53:21.834 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:28:35.085 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:53:21.836 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:28:34.988 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:53:21.992 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:28:35.145 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:53:22.018 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:28:35.269 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:53:22.074 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:28:35.227 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:54:34.889 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:29:48.042 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:54:34.921 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:29:48.074 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:54:34.923 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:29:48.076 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:54:34.926 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:29:48.079 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:54:34.948 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:29:48.199 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:54:34.951 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:29:48.201 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T12:54:34.973 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:29:48.126 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T12:54:34.982 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:29:48.135 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T12:54:35.056 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:29:48.306 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:02:56.547 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:38:09.701 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:02:56.561 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:38:09.715 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:02:56.587 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:38:09.741 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:02:56.590 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:38:09.744 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:02:56.596 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:38:09.847 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:02:56.604 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:38:09.855 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:02:56.827 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:38:10.078 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:02:56.828 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:38:09.982 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:02:56.833 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:38:09.987 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:03:42.896 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:38:56.050 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:03:42.903 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:38:56.057 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:03:42.914 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:38:56.165 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:03:42.919 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:38:56.073 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:03:42.925 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:38:56.079 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:03:42.926 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:38:56.177 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:03:42.972 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:38:56.126 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:03:42.974 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:38:56.128 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:03:42.976 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:38:56.227 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:08:56.400 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:44:09.553 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:08:56.405 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:44:09.559 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:08:56.417 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:44:09.571 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:08:56.420 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:44:09.574 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:08:56.424 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:44:09.675 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:08:56.435 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:44:09.685 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:08:56.597 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:44:09.750 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:08:56.622 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:44:09.776 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:08:56.731 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:44:09.982 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:11:28.415 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:46:41.568 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:11:28.440 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:46:41.593 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:11:28.452 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:46:41.702 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:11:28.458 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:46:41.611 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:11:28.459 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:46:41.612 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:11:28.468 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:46:41.718 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:11:28.523 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:46:41.669 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:11:28.532 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:46:41.683 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:11:28.535 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:46:41.785 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:14:10.628 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:49:23.781 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:14:10.645 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:49:23.790 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:14:10.645 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:49:23.797 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:14:10.649 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:49:23.802 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:14:10.663 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:49:23.913 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:14:10.676 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:49:23.926 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:14:10.742 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:49:23.895 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:14:10.760 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:49:23.913 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:14:10.844 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:49:24.095 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:23.356 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:54:36.509 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:23.361 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:54:36.513 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:23.368 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:54:36.520 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:23.372 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:54:36.525 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:23.380 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:54:36.631 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:23.396 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:54:36.647 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:23.554 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:54:36.706 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:23.554 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:54:36.707 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:23.588 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:54:36.839 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:50.020 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:55:03.172 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:50.022 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:55:03.174 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:50.027 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:55:03.179 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:50.033 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:55:03.284 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:50.040 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:55:03.291 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:50.054 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:55:03.207 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:50.056 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:55:03.208 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:50.078 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:55:03.329 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:19:50.082 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:55:03.234 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:24:35.047 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:59:48.199 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:24:35.052 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:59:48.204 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:24:35.063 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:59:48.215 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:24:35.065 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:59:48.217 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:24:35.080 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:59:48.330 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:24:35.114 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:59:48.365 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:24:35.250 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:03:59:48.402 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:24:35.250 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:03:59:48.403 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:24:35.344 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:03:59:48.594 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:28:11.569 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:03:24.721 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:28:11.620 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:03:24.772 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:28:11.629 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:03:24.781 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:28:11.633 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:03:24.785 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:28:11.654 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:03:24.904 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:28:11.657 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:03:24.907 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:28:11.777 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:03:24.928 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:28:11.780 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:03:24.932 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:28:11.785 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:03:25.036 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:29:43.998 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:04:57.150 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:29:44.004 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:04:57.156 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:29:44.029 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:04:57.279 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:29:44.034 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:04:57.285 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:29:44.035 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:04:57.187 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:29:44.039 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:04:57.191 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:29:44.097 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:04:57.249 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:29:44.149 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:04:57.301 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:29:44.150 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:04:57.401 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:34:57.596 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:10:10.747 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:34:57.606 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:10:10.757 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:34:57.616 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:10:10.767 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:34:57.620 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:10:10.771 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:34:57.627 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:10:10.876 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:34:57.632 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:10:10.882 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:34:57.798 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:10:10.950 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:34:57.825 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:10:10.977 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:34:57.834 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:10:11.085 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:36:33.341 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:11:46.492 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:36:33.374 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:11:46.525 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:36:33.394 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:11:46.545 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:36:33.395 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:11:46.546 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:36:33.412 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:11:46.662 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:36:33.418 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:11:46.668 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:36:33.450 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:11:46.601 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:36:33.483 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:11:46.733 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:36:33.507 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:11:46.658 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:40:09.165 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:15:22.316 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:40:09.172 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:15:22.323 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:40:09.184 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:15:22.335 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:40:09.187 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:15:22.437 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:40:09.191 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:15:22.441 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:40:09.192 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:15:22.343 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:40:09.319 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:15:22.469 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:40:09.330 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:15:22.482 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:40:09.362 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:15:22.612 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:44:54.904 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:20:08.055 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:44:54.950 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:20:08.100 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:44:54.957 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:20:08.207 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:44:54.960 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:20:08.210 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:44:54.964 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:20:08.115 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:44:54.968 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:20:08.119 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:44:55.077 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:20:08.327 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:44:55.084 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:20:08.235 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:44:55.159 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:20:08.310 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:45:20.104 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:20:33.254 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:45:20.112 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:20:33.262 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:45:20.118 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:20:33.368 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:45:20.122 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:20:33.372 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:45:20.125 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:20:33.276 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:45:20.128 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:20:33.279 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:45:20.150 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:20:33.301 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:45:20.163 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:20:33.313 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:45:20.163 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:20:33.413 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:49:56.100 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:25:09.250 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:49:56.151 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:25:09.301 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:49:56.190 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:25:09.341 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:49:56.193 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:25:09.344 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:49:56.201 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:25:09.451 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:49:56.203 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:25:09.453 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:49:56.331 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:25:09.481 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:49:56.404 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:25:09.554 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:49:56.419 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:25:09.669 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:50:32.277 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:25:45.427 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:50:32.280 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:25:45.430 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:50:32.292 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:25:45.442 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:50:32.295 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:25:45.446 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:50:32.305 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:25:45.555 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:50:32.309 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:25:45.559 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:50:32.324 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:25:45.474 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:50:32.338 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:25:45.488 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:50:32.381 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:25:45.631 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:53:16.696 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:28:29.847 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:53:16.745 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:28:29.896 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:53:16.751 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:28:29.902 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:53:16.765 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:28:30.015 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:53:16.777 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:28:30.027 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:53:16.785 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:28:29.936 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:53:16.853 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:28:30.004 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:53:16.867 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:28:30.117 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:53:16.870 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:28:30.020 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:55:43.294 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:30:56.445 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:55:43.296 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:30:56.447 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:55:43.303 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:30:56.454 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:55:43.308 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:30:56.459 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:55:43.309 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:30:56.560 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:55:43.314 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:30:56.564 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T13:55:43.398 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:30:56.549 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T13:55:43.417 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:30:56.568 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T13:55:43.425 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:30:56.675 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:00:56.536 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:36:09.687 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:00:56.543 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:36:09.695 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:00:56.553 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:36:09.705 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:00:56.556 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:36:09.708 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:00:56.567 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:36:09.818 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:00:56.576 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:36:09.827 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:00:56.738 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:36:09.889 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:00:56.740 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:36:09.892 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:00:56.848 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:36:10.099 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:01:38.256 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:36:51.408 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:01:38.263 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:36:51.415 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:01:38.264 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:36:51.416 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:01:38.298 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:36:51.549 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:01:38.300 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:36:51.451 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:01:38.300 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:36:51.551 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:01:38.306 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:36:51.458 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:01:38.342 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:36:51.593 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:01:38.346 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:36:51.497 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:06:08.769 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:41:21.921 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:06:08.777 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:41:21.929 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:06:08.788 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:41:21.940 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:06:08.794 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:41:21.946 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:06:08.799 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:41:22.050 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:06:08.807 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:41:22.058 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:06:08.959 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:41:22.111 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:06:08.984 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:41:22.136 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:06:08.993 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:41:22.244 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:09:59.913 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:45:13.065 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:09:59.950 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:45:13.102 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:09:59.953 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:45:13.105 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:09:59.979 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:45:13.230 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:09:59.983 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:45:13.234 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:09:59.993 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:45:13.144 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:10:00.069 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:45:13.221 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:10:00.101 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:45:13.352 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:10:00.113 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:45:13.265 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:11:20.270 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:46:33.422 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:11:20.279 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:46:33.431 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:11:20.295 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:46:33.447 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:11:20.298 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:46:33.549 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:11:20.308 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:46:33.460 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:11:20.312 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:46:33.563 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:11:20.393 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:46:33.545 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:11:20.399 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:46:33.551 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:11:20.423 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:46:33.674 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:16:33.130 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:51:46.281 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:16:33.135 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:51:46.286 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:16:33.153 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:51:46.305 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:16:33.158 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:51:46.310 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:16:33.166 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:51:46.418 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:16:33.177 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:51:46.428 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:16:33.369 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:51:46.520 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:16:33.370 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:51:46.621 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:16:33.382 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:51:46.534 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:18:21.437 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:53:34.588 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:18:21.476 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:53:34.727 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:18:21.481 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:53:34.632 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:18:21.518 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:53:34.669 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:18:21.520 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:53:34.671 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:18:21.525 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:53:34.776 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:18:21.574 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:53:34.726 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:18:21.601 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:53:34.753 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:18:21.620 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:53:34.871 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:19:47.099 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-11-25T14:19:47.106 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-11-25T14:19:47.106 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-11-25T14:19:47.106 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-11-25T14:19:47.106 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-11-25T14:19:47.106 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-11-25T14:19:47.106 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-11-25T14:19:47.487 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-11-25T14:19:47.667 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-11-25T14:19:48.018 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-11-25T14:19:48.043 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-11-25T14:19:48.062 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-11-25T14:19:48.063 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-11-25T14:19:48.063 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-11-25T14:19:48.063 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-11-25T14:19:48.063 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-11-25T14:19:48.063 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-11-25T14:19:48.063 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-11-25T14:19:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-11-25T14:19:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-11-25T14:19:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-11-25T14:19:48.064 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-11-25T14:19:48.068 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-11-25T14:19:48.068 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-11-25T14:19:48.068 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-11-25T14:19:48.068 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_child ... ok 2019-11-25T14:19:48.072 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-11-25T14:19:48.073 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-11-25T14:19:48.073 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-11-25T14:19:48.073 INFO:teuthology.orchestra.run.smithi135.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-11-25T14:19:48.095 INFO:teuthology.orchestra.run.smithi135.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-11-25T14:19:48.116 INFO:teuthology.orchestra.run.smithi135.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-11-25T14:19:48.116 INFO:teuthology.orchestra.run.smithi135.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-11-25T14:19:48.257 INFO:teuthology.orchestra.run.smithi135.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-11-25T14:19:48.257 INFO:teuthology.orchestra.run.smithi135.stderr: 2019-11-25T14:19:48.257 INFO:teuthology.orchestra.run.smithi135.stderr:---------------------------------------------------------------------- 2019-11-25T14:19:48.257 INFO:teuthology.orchestra.run.smithi135.stderr:Ran 611 tests in 13810.677s 2019-11-25T14:19:48.257 INFO:teuthology.orchestra.run.smithi135.stderr: 2019-11-25T14:19:48.258 INFO:teuthology.orchestra.run.smithi135.stderr:OK (SKIP=75) 2019-11-25T14:19:48.304 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2019-11-25T14:19:48.305 INFO:teuthology.orchestra.run.smithi135:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2019-11-25T14:19:48.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-11-25T14:19:48.428 INFO:tasks.s3tests:Cleaning up boto... 2019-11-25T14:19:48.429 INFO:teuthology.orchestra.run.smithi135:> rm /home/ubuntu/cephtest/boto.cfg 2019-11-25T14:19:48.474 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data --cluster ceph 2019-11-25T14:19:48.584 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.586+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.610 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.613+0000 7effd8679ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:48.610 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.613+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.623+0000 7effd8679ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.623+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.627 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.630+0000 7effd8679ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:48.628 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.630+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.643 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.646+0000 7effd8679ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:48.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.857+0000 7effd8679ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T14:19:48.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.857+0000 7effd8679ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T14:19:48.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.857+0000 7effd8679ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T14:19:48.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.857+0000 7effd8679ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T14:19:48.855 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.857+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.872 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.875+0000 7effd8679ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:48.872 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.875+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.890+0000 7effd8679ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T14:19:48.888 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.890+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.901 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.903+0000 7effd8679ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:48.901 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.903+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.914 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.917+0000 7effd8679ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T14:19:48.915 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.917+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.922 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.925+0000 7effd8679ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.925+0000 7effd8679ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T14:19:48.923 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.925+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.928 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.931+0000 7effd8679ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.931+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.942 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.944+0000 7effd8679ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:48.942 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.944+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.961 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.963+0000 7effd8679ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T14:19:48.961 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.963+0000 7effd8679ec0 20 zonegroup default 2019-11-25T14:19:48.962 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.963+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.971 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.973+0000 7effd8679ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:48.971 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.973+0000 7effd8679ec0 10 Cannot find current period zone using local zone 2019-11-25T14:19:48.971 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.973+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.980 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.982+0000 7effd8679ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:48.980 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.982+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:48.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.996+0000 7effd8679ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:48.993 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:48.996+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:49.005 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.008+0000 7effd8679ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T14:19:49.005 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.008+0000 7effd8679ec0 20 zone default found 2019-11-25T14:19:49.005 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.008+0000 7effd8679ec0 20 started sync module instance, tier type = 2019-11-25T14:19:49.006 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.008+0000 7effd8679ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T14:19:49.534 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.537+0000 7effd8679ec0 20 add_watcher() i=0 2019-11-25T14:19:49.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.537+0000 7effd8679ec0 20 add_watcher() i=1 2019-11-25T14:19:49.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.537+0000 7effd8679ec0 20 add_watcher() i=2 2019-11-25T14:19:49.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.537+0000 7effd8679ec0 20 add_watcher() i=3 2019-11-25T14:19:49.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.537+0000 7effd8679ec0 20 add_watcher() i=4 2019-11-25T14:19:49.535 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.537+0000 7effd8679ec0 20 add_watcher() i=5 2019-11-25T14:19:49.536 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.539+0000 7effd8679ec0 20 add_watcher() i=6 2019-11-25T14:19:49.577 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.580+0000 7effd8679ec0 20 add_watcher() i=7 2019-11-25T14:19:49.577 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.580+0000 7effd8679ec0 2 all 8 watchers are set, enabling cache 2019-11-25T14:19:49.577 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.580+0000 7eff967dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T14:19:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.588+0000 7effc58a7700 0 -- 172.21.15.135:0/2675836844 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56265bb301b0 msgr2=0x56265bb36a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T14:19:49.622 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:49.625+0000 7effc60a8700 0 -- 172.21.15.135:0/2830127975 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56265bb36230 msgr2=0x56265bb36640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T14:19:50.947 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.949+0000 7eff0cff9700 20 reqs_thread_entry: start 2019-11-25T14:19:50.948 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.949+0000 7eff067fc700 20 reqs_thread_entry: start 2019-11-25T14:19:50.948 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.949+0000 7effd8679ec0 20 init_complete bucket index max shards: 0 2019-11-25T14:19:50.949 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.950+0000 7eff04ff9700 20 reqs_thread_entry: start 2019-11-25T14:19:50.949 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.950+0000 7effd8679ec0 20 get_system_obj_state: rctx=0x7ffdf0e929f8 obj=default.rgw.meta:users.uid:bar.client.0 state=0x56265bbb01d0 s->prefetch_data=0 2019-11-25T14:19:50.949 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.951+0000 7effd8679ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-25T14:19:50.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.968+0000 7effd8679ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-11-25T14:19:50.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.968+0000 7effd8679ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T14:19:50.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.968+0000 7effd8679ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T14:19:50.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.968+0000 7effd8679ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T14:19:50.967 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.968+0000 7effd8679ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-25T14:19:50.968 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.968+0000 7effd8679ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:50.981 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.983+0000 7effd8679ec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-25T14:19:50.981 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.983+0000 7effd8679ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-11-25T14:19:50.982 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:50.983+0000 7effd8679ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T14:19:51.173 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:51.175+0000 7effd8679ec0 10 removing key index: HFQOFSLPWPXHSNLQOFSG 2019-11-25T14:19:51.173 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:51.175+0000 7effd8679ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=170 2019-11-25T14:19:51.182 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:51.184+0000 7effa6ffd700 10 RGWWatcher::handle_notify() notify_id 588410519660 cookie 94722747148848 notifier 4658 bl.length()=170 2019-11-25T14:19:51.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:51.371+0000 7effd8679ec0 10 removing email index: bar.client.0+test@test.test 2019-11-25T14:19:51.370 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:51.371+0000 7effd8679ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=178 2019-11-25T14:19:51.400 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:51.402+0000 7effa6ffd700 10 RGWWatcher::handle_notify() notify_id 588410519714 cookie 94722747139136 notifier 4658 bl.length()=178 2019-11-25T14:19:51.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:51.904+0000 7effd8679ec0 10 removing user buckets index 2019-11-25T14:19:51.903 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:51.904+0000 7effd8679ec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=169 2019-11-25T14:19:51.921 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:51.922+0000 7effa6ffd700 10 RGWWatcher::handle_notify() notify_id 588410519652 cookie 94722747141040 notifier 4658 bl.length()=169 2019-11-25T14:19:52.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:52.360+0000 7effd8679ec0 10 removing user index: bar.client.0 2019-11-25T14:19:52.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:52.361+0000 7effd8679ec0 10 removing default.rgw.meta+users.uid+bar.client.0 from cache 2019-11-25T14:19:52.359 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:52.361+0000 7effd8679ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=161 2019-11-25T14:19:52.385 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:52.387+0000 7effa6ffd700 10 RGWWatcher::handle_notify() notify_id 588410519715 cookie 94722747139136 notifier 4658 bl.length()=161 2019-11-25T14:19:52.831 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:52.833+0000 7effd8679ec0 20 remove_watcher() i=0 2019-11-25T14:19:52.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:52.833+0000 7effd8679ec0 2 removed watcher, disabling cache 2019-11-25T14:19:52.891 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:52.893+0000 7effd8679ec0 20 remove_watcher() i=1 2019-11-25T14:19:52.956 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:52.957+0000 7effd8679ec0 20 remove_watcher() i=2 2019-11-25T14:19:53.007 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.009+0000 7effd8679ec0 20 remove_watcher() i=3 2019-11-25T14:19:53.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.065+0000 7effd8679ec0 20 remove_watcher() i=4 2019-11-25T14:19:53.126 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.128+0000 7effd8679ec0 20 remove_watcher() i=5 2019-11-25T14:19:53.196 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.198+0000 7effd8679ec0 20 remove_watcher() i=6 2019-11-25T14:19:53.238 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.240+0000 7effd8679ec0 20 remove_watcher() i=7 2019-11-25T14:19:53.250 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2019-11-25T14:19:53.372 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.374+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:53.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.398+0000 7f7f63d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:53.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.398+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:53.402 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.404+0000 7f7f63d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:53.403 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.404+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:53.410 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.412+0000 7f7f63d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:53.411 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.412+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:53.440 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:53.440+0000 7f7f63d74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:54.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.176+0000 7f7f63d74ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T14:19:54.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.176+0000 7f7f63d74ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T14:19:54.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.176+0000 7f7f63d74ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T14:19:54.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.176+0000 7f7f63d74ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T14:19:54.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.176+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.185 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.187+0000 7f7f63d74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:54.185 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.187+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.205+0000 7f7f63d74ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T14:19:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.205+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.219+0000 7f7f63d74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.219+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.234+0000 7f7f63d74ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T14:19:54.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.234+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.242+0000 7f7f63d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:54.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.242+0000 7f7f63d74ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T14:19:54.241 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.242+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.249 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.251+0000 7f7f63d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:54.250 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.251+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.261 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.263+0000 7f7f63d74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:54.261 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.263+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.276 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.278+0000 7f7f63d74ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T14:19:54.277 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.278+0000 7f7f63d74ec0 20 zonegroup default 2019-11-25T14:19:54.277 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.278+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.285+0000 7f7f63d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:54.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.285+0000 7f7f63d74ec0 10 Cannot find current period zone using local zone 2019-11-25T14:19:54.284 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.285+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.291 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.293+0000 7f7f63d74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:54.291 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.293+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.386+0000 7f7f63d74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:54.383 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.386+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:54.402 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.404+0000 7f7f63d74ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T14:19:54.402 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.404+0000 7f7f63d74ec0 20 zone default found 2019-11-25T14:19:54.402 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.404+0000 7f7f63d74ec0 20 started sync module instance, tier type = 2019-11-25T14:19:54.402 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.404+0000 7f7f63d74ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T14:19:54.805 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.808+0000 7f7f63d74ec0 20 add_watcher() i=0 2019-11-25T14:19:54.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.808+0000 7f7f63d74ec0 20 add_watcher() i=1 2019-11-25T14:19:54.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.808+0000 7f7f63d74ec0 20 add_watcher() i=2 2019-11-25T14:19:54.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.808+0000 7f7f63d74ec0 20 add_watcher() i=3 2019-11-25T14:19:54.806 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.808+0000 7f7f63d74ec0 20 add_watcher() i=4 2019-11-25T14:19:54.807 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.808+0000 7f7f63d74ec0 20 add_watcher() i=5 2019-11-25T14:19:54.807 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.808+0000 7f7f63d74ec0 20 add_watcher() i=6 2019-11-25T14:19:54.835 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.837+0000 7f7f63d74ec0 20 add_watcher() i=7 2019-11-25T14:19:54.835 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.837+0000 7f7f63d74ec0 2 all 8 watchers are set, enabling cache 2019-11-25T14:19:54.835 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.837+0000 7f7f217e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T14:19:54.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.855+0000 7f7f517a3700 0 -- 172.21.15.135:0/1378412786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556b06ee2d40 msgr2=0x556b06ee3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T14:19:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:54.904+0000 7f7f507a1700 0 -- 172.21.15.135:0/1513565548 >> [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] conn(0x556b06efb390 msgr2=0x556b06efd7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-25T14:19:56.649 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.651+0000 7f7e937fe700 20 reqs_thread_entry: start 2019-11-25T14:19:56.649 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.652+0000 7f7e917fa700 20 reqs_thread_entry: start 2019-11-25T14:19:56.649 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.652+0000 7f7f63d74ec0 20 init_complete bucket index max shards: 0 2019-11-25T14:19:56.650 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.653+0000 7f7e7f7fe700 20 reqs_thread_entry: start 2019-11-25T14:19:56.650 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.653+0000 7f7f63d74ec0 20 get_system_obj_state: rctx=0x7ffcbf1fce78 obj=default.rgw.meta:users.uid:foo.client.0 state=0x556b06f61ec0 s->prefetch_data=0 2019-11-25T14:19:56.650 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.653+0000 7f7f63d74ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-25T14:19:56.671 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.673+0000 7f7f63d74ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-11-25T14:19:56.671 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.673+0000 7f7f63d74ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T14:19:56.671 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.673+0000 7f7f63d74ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T14:19:56.672 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.673+0000 7f7f63d74ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T14:19:56.672 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.673+0000 7f7f63d74ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-25T14:19:56.672 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.673+0000 7f7f63d74ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:56.682 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.685+0000 7f7f63d74ec0 20 rados_obj.operate() r=0 bl.length=446 2019-11-25T14:19:56.683 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.685+0000 7f7f63d74ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-11-25T14:19:56.683 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.685+0000 7f7f63d74ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T14:19:56.847 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.849+0000 7f7f63d74ec0 10 removing key index: IAYFINFLWKVADFPLMXOU 2019-11-25T14:19:56.847 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.850+0000 7f7f63d74ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=170 2019-11-25T14:19:56.867 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:56.870+0000 7f7f367fc700 10 RGWWatcher::handle_notify() notify_id 588410520118 cookie 93918166079616 notifier 4673 bl.length()=170 2019-11-25T14:19:57.492 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:57.495+0000 7f7f63d74ec0 10 removing email index: foo.client.0+test@test.test 2019-11-25T14:19:57.492 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:57.495+0000 7f7f63d74ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=178 2019-11-25T14:19:57.502 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:57.505+0000 7f7f367fc700 10 RGWWatcher::handle_notify() notify_id 588410519661 cookie 93918166078976 notifier 4673 bl.length()=178 2019-11-25T14:19:57.933 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:57.936+0000 7f7f63d74ec0 10 removing user buckets index 2019-11-25T14:19:57.934 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:57.936+0000 7f7f63d74ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=169 2019-11-25T14:19:57.983 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:57.985+0000 7f7f367fc700 10 RGWWatcher::handle_notify() notify_id 588410519716 cookie 93918166066304 notifier 4673 bl.length()=169 2019-11-25T14:19:58.417 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:58.420+0000 7f7f63d74ec0 10 removing user index: foo.client.0 2019-11-25T14:19:58.417 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:58.420+0000 7f7f63d74ec0 10 removing default.rgw.meta+users.uid+foo.client.0 from cache 2019-11-25T14:19:58.418 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:58.420+0000 7f7f63d74ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=161 2019-11-25T14:19:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:58.437+0000 7f7f367fc700 10 RGWWatcher::handle_notify() notify_id 588410520119 cookie 93918166062928 notifier 4673 bl.length()=161 2019-11-25T14:19:58.666 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:58.669+0000 7f7f63d74ec0 20 remove_watcher() i=0 2019-11-25T14:19:58.666 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:58.669+0000 7f7f63d74ec0 2 removed watcher, disabling cache 2019-11-25T14:19:58.715 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:58.718+0000 7f7f63d74ec0 20 remove_watcher() i=1 2019-11-25T14:19:58.775 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:58.778+0000 7f7f63d74ec0 20 remove_watcher() i=2 2019-11-25T14:19:58.819 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:58.822+0000 7f7f63d74ec0 20 remove_watcher() i=3 2019-11-25T14:19:58.873 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:58.876+0000 7f7f63d74ec0 20 remove_watcher() i=4 2019-11-25T14:19:59.010 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.013+0000 7f7f63d74ec0 20 remove_watcher() i=5 2019-11-25T14:19:59.057 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.060+0000 7f7f63d74ec0 20 remove_watcher() i=6 2019-11-25T14:19:59.099 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.101+0000 7f7f63d74ec0 20 remove_watcher() i=7 2019-11-25T14:19:59.105 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid 'testx$tenanteduser.client.0' --purge-data --cluster ceph 2019-11-25T14:19:59.232 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.235+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.263+0000 7f552b762ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.264+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.271+0000 7f552b762ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:59.269 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.271+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.276 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.279+0000 7f552b762ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:59.276 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.279+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.290 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.292+0000 7f552b762ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:59.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.583+0000 7f552b762ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T14:19:59.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.583+0000 7f552b762ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T14:19:59.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.583+0000 7f552b762ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T14:19:59.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.583+0000 7f552b762ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T14:19:59.581 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.583+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.599+0000 7f552b762ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:59.596 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.599+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.614 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.616+0000 7f552b762ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T14:19:59.614 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.617+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.632 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.635+0000 7f552b762ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:59.633 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.635+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.649 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.651+0000 7f552b762ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T14:19:59.649 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.651+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.663+0000 7f552b762ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.663+0000 7f552b762ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T14:19:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.663+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.670 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.673+0000 7f552b762ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:59.671 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.673+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.686 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.688+0000 7f552b762ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:59.686 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.688+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.703 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.706+0000 7f552b762ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T14:19:59.704 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.706+0000 7f552b762ec0 20 zonegroup default 2019-11-25T14:19:59.704 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.706+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.717+0000 7f552b762ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:59.714 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.717+0000 7f552b762ec0 10 Cannot find current period zone using local zone 2019-11-25T14:19:59.715 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.717+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.724 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.727+0000 7f552b762ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:19:59.725 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.727+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.743 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.745+0000 7f552b762ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:19:59.743 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.745+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:19:59.761 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.763+0000 7f552b762ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T14:19:59.761 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.763+0000 7f552b762ec0 20 zone default found 2019-11-25T14:19:59.761 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.763+0000 7f552b762ec0 20 started sync module instance, tier type = 2019-11-25T14:19:59.762 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:19:59.763+0000 7f552b762ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T14:20:00.153 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.156+0000 7f552b762ec0 20 add_watcher() i=0 2019-11-25T14:20:00.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.156+0000 7f552b762ec0 20 add_watcher() i=1 2019-11-25T14:20:00.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.156+0000 7f552b762ec0 20 add_watcher() i=2 2019-11-25T14:20:00.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.156+0000 7f552b762ec0 20 add_watcher() i=3 2019-11-25T14:20:00.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.156+0000 7f552b762ec0 20 add_watcher() i=4 2019-11-25T14:20:00.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.156+0000 7f552b762ec0 20 add_watcher() i=5 2019-11-25T14:20:00.154 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.156+0000 7f552b762ec0 20 add_watcher() i=6 2019-11-25T14:20:00.185 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.188+0000 7f552b762ec0 20 add_watcher() i=7 2019-11-25T14:20:00.186 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.188+0000 7f552b762ec0 2 all 8 watchers are set, enabling cache 2019-11-25T14:20:00.186 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.188+0000 7f54e8fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T14:20:00.198 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.201+0000 7f5519191700 0 -- 172.21.15.135:0/1370761111 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557a74a0ad50 msgr2=0x557a74a0b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T14:20:00.222 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:00.225+0000 7f5513fff700 0 -- 172.21.15.135:0/4148580801 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x557a74a171b0 msgr2=0x557a74a195d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T14:20:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:01.980+0000 7f545affd700 20 reqs_thread_entry: start 2019-11-25T14:20:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:01.980+0000 7f5458ff9700 20 reqs_thread_entry: start 2019-11-25T14:20:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:01.981+0000 7f552b762ec0 20 init_complete bucket index max shards: 0 2019-11-25T14:20:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:01.981+0000 7f544effd700 20 reqs_thread_entry: start 2019-11-25T14:20:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:01.981+0000 7f552b762ec0 20 get_system_obj_state: rctx=0x7ffeb2254c98 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x557a74a88d50 s->prefetch_data=0 2019-11-25T14:20:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:01.981+0000 7f552b762ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-11-25T14:20:02.000 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.002+0000 7f552b762ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-11-25T14:20:02.000 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.002+0000 7f552b762ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T14:20:02.000 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.002+0000 7f552b762ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-11-25T14:20:02.000 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.002+0000 7f552b762ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-11-25T14:20:02.000 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.002+0000 7f552b762ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-11-25T14:20:02.001 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.002+0000 7f552b762ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:02.018 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.021+0000 7f552b762ec0 20 rados_obj.operate() r=0 bl.length=505 2019-11-25T14:20:02.019 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.021+0000 7f552b762ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-11-25T14:20:02.019 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.021+0000 7f552b762ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-11-25T14:20:02.029 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.032+0000 7f552b762ec0 10 removing key index: VKFDEXRGAVQTIJTYMLQI 2019-11-25T14:20:02.030 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.032+0000 7f552b762ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=170 2019-11-25T14:20:02.049 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.052+0000 7f5501ffb700 10 RGWWatcher::handle_notify() notify_id 588410519662 cookie 93984431002624 notifier 5064 bl.length()=170 2019-11-25T14:20:02.258 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.260+0000 7f552b762ec0 10 removing email index: testx$tenanteduser.client.0+test@test.test 2019-11-25T14:20:02.258 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.260+0000 7f552b762ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=193 2019-11-25T14:20:02.290 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.293+0000 7f5501ffb700 10 RGWWatcher::handle_notify() notify_id 588410520120 cookie 93984431004304 notifier 5064 bl.length()=193 2019-11-25T14:20:02.585 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.588+0000 7f552b762ec0 10 removing user buckets index 2019-11-25T14:20:02.585 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.588+0000 7f552b762ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=184 2019-11-25T14:20:02.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.607+0000 7f5501ffb700 10 RGWWatcher::handle_notify() notify_id 588410519663 cookie 93984431002624 notifier 5064 bl.length()=184 2019-11-25T14:20:02.737 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.740+0000 7f552b762ec0 10 removing user index: testx$tenanteduser.client.0 2019-11-25T14:20:02.737 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.740+0000 7f552b762ec0 10 removing default.rgw.meta+users.uid+testx$tenanteduser.client.0 from cache 2019-11-25T14:20:02.738 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.740+0000 7f552b762ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=176 2019-11-25T14:20:02.748 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:02.750+0000 7f5501ffb700 10 RGWWatcher::handle_notify() notify_id 588410519717 cookie 93984431000640 notifier 5064 bl.length()=176 2019-11-25T14:20:03.421 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:03.423+0000 7f552b762ec0 20 remove_watcher() i=0 2019-11-25T14:20:03.421 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:03.423+0000 7f552b762ec0 2 removed watcher, disabling cache 2019-11-25T14:20:03.462 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:03.464+0000 7f552b762ec0 20 remove_watcher() i=1 2019-11-25T14:20:03.522 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:03.524+0000 7f552b762ec0 20 remove_watcher() i=2 2019-11-25T14:20:03.572 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:03.575+0000 7f552b762ec0 20 remove_watcher() i=3 2019-11-25T14:20:03.632 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:03.634+0000 7f552b762ec0 20 remove_watcher() i=4 2019-11-25T14:20:03.682 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:03.685+0000 7f552b762ec0 20 remove_watcher() i=5 2019-11-25T14:20:03.727 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:03.730+0000 7f552b762ec0 20 remove_watcher() i=6 2019-11-25T14:20:03.759 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:03.762+0000 7f552b762ec0 20 remove_watcher() i=7 2019-11-25T14:20:03.773 INFO:tasks.s3tests:Removing s3-tests... 2019-11-25T14:20:03.773 INFO:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/s3-tests 2019-11-25T14:20:03.901 INFO:teuthology.run_tasks:Running task swift... 2019-11-25T14:20:03.920 INFO:tasks.swift:clients=['client.0'] 2019-11-25T14:20:03.920 INFO:tasks.swift:Downloading swift... 2019-11-25T14:20:03.920 INFO:teuthology.orchestra.run.smithi135:> git clone -b ceph-master git://git.ceph.com/git/swift.git /home/ubuntu/cephtest/swift 2019-11-25T14:20:04.041 INFO:teuthology.orchestra.run.smithi135.stdout:Cloning into '/home/ubuntu/cephtest/swift'... 2019-11-25T14:20:04.475 INFO:tasks.swift:Creating rgw users... 2019-11-25T14:20:04.476 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser foo.client.0:foo --display-name 'Mr. foo.client.0 foo' --secret /rDV//tGidkqhbcQLGLYLjrBzylLSX3cfssL92lR29elyZKwwUJMjw== --email foo.client.0+test@test.test --key-type swift --access full 2019-11-25T14:20:04.662 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.665+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.688 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.691+0000 7f4e9cc09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:04.689 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.691+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.695 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.698+0000 7f4e9cc09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:04.696 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.698+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.702 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.705+0000 7f4e9cc09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:04.702 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.705+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.723+0000 7f4e9cc09ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:20:04.910 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.912+0000 7f4e9cc09ec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T14:20:04.910 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.912+0000 7f4e9cc09ec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T14:20:04.910 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.912+0000 7f4e9cc09ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T14:20:04.910 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.912+0000 7f4e9cc09ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T14:20:04.911 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.912+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.922 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.924+0000 7f4e9cc09ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:20:04.922 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.924+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.932 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.935+0000 7f4e9cc09ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T14:20:04.932 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.935+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.945+0000 7f4e9cc09ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:20:04.943 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.945+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.952 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.955+0000 7f4e9cc09ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T14:20:04.952 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.955+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.957 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.960+0000 7f4e9cc09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:04.958 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.960+0000 7f4e9cc09ec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T14:20:04.958 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.960+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.964 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.965+0000 7f4e9cc09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:04.964 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.965+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.980 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.981+0000 7f4e9cc09ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:20:04.980 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.981+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:04.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.991+0000 7f4e9cc09ec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T14:20:04.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.991+0000 7f4e9cc09ec0 20 zonegroup default 2019-11-25T14:20:04.989 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.991+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:05.001 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.996+0000 7f4e9cc09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:05.001 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.997+0000 7f4e9cc09ec0 10 Cannot find current period zone using local zone 2019-11-25T14:20:05.001 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:04.997+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:05.001 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.001+0000 7f4e9cc09ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:05.002 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.001+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:05.009 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.012+0000 7f4e9cc09ec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:20:05.009 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.012+0000 7f4e9cc09ec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:05.017 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.019+0000 7f4e9cc09ec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T14:20:05.017 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.019+0000 7f4e9cc09ec0 20 zone default found 2019-11-25T14:20:05.017 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.019+0000 7f4e9cc09ec0 20 started sync module instance, tier type = 2019-11-25T14:20:05.017 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.019+0000 7f4e9cc09ec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T14:20:05.372 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.374+0000 7f4e89e37700 0 -- 172.21.15.135:0/1421514870 >> [v2:172.21.15.135:6808/10392,v1:172.21.15.135:6809/10392] conn(0x7f4e84006af0 msgr2=0x7f4e84003820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T14:20:05.372 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.375+0000 7f4e9cc09ec0 20 add_watcher() i=0 2019-11-25T14:20:05.372 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.375+0000 7f4e9cc09ec0 20 add_watcher() i=1 2019-11-25T14:20:05.373 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.375+0000 7f4e9cc09ec0 20 add_watcher() i=2 2019-11-25T14:20:05.373 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.375+0000 7f4e9cc09ec0 20 add_watcher() i=3 2019-11-25T14:20:05.373 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.375+0000 7f4e9cc09ec0 20 add_watcher() i=4 2019-11-25T14:20:05.374 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.375+0000 7f4e9cc09ec0 20 add_watcher() i=5 2019-11-25T14:20:05.374 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.375+0000 7f4e9cc09ec0 20 add_watcher() i=6 2019-11-25T14:20:05.416 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.418+0000 7f4e9cc09ec0 20 add_watcher() i=7 2019-11-25T14:20:05.417 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.418+0000 7f4e9cc09ec0 2 all 8 watchers are set, enabling cache 2019-11-25T14:20:05.417 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.419+0000 7f4e5a7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T14:20:05.447 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.449+0000 7f4e89636700 0 -- 172.21.15.135:0/212363082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56525dedb0d0 msgr2=0x56525dedd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-11-25T14:20:05.649 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:05.651+0000 7f4e89636700 0 --2- 172.21.15.135:0/212363082 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x56525dedb0d0 0x56525dedd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-11-25T14:20:07.293 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.295+0000 7f4dd0ff9700 20 reqs_thread_entry: start 2019-11-25T14:20:07.293 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.295+0000 7f4dca7fc700 20 reqs_thread_entry: start 2019-11-25T14:20:07.293 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.295+0000 7f4e9cc09ec0 20 init_complete bucket index max shards: 0 2019-11-25T14:20:07.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.296+0000 7f4dc8ff9700 20 reqs_thread_entry: start 2019-11-25T14:20:07.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.297+0000 7f4e9cc09ec0 20 get_system_obj_state: rctx=0x7fff5beeb368 obj=default.rgw.meta:users.uid:foo.client.0 state=0x56525df471a0 s->prefetch_data=0 2019-11-25T14:20:07.294 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.297+0000 7f4e9cc09ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-11-25T14:20:07.306 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.309+0000 7f4e9cc09ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-11-25T14:20:07.306 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.309+0000 7f4e9cc09ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T14:20:07.307 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.309+0000 7f4e9cc09ec0 20 get_system_obj_state: rctx=0x7fff5beeb378 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x56525df48f30 s->prefetch_data=0 2019-11-25T14:20:07.307 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.309+0000 7f4e9cc09ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-11-25T14:20:07.319 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.322+0000 7f4e9cc09ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-11-25T14:20:07.320 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.322+0000 7f4e9cc09ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-25T14:20:07.320 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.322+0000 7f4e9cc09ec0 20 get_system_obj_state: rctx=0x7fff5beeaf88 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x56525df48f30 s->prefetch_data=0 2019-11-25T14:20:07.320 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.322+0000 7f4e9cc09ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : miss 2019-11-25T14:20:07.332 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.334+0000 7f4e9cc09ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-25T14:20:07.332 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.334+0000 7f4e9cc09ec0 10 adding default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-25T14:20:07.332 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.334+0000 7f4e9cc09ec0 20 get_system_obj_state: rctx=0x7fff5beeb108 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x56525df491e0 s->prefetch_data=0 2019-11-25T14:20:07.332 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.334+0000 7f4e9cc09ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : type miss (requested=0x6, cached=0x0) 2019-11-25T14:20:07.340 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.343+0000 7f4e9cc09ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-11-25T14:20:07.341 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.343+0000 7f4e9cc09ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-25T14:20:07.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.398+0000 7f4e9cc09ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-25T14:20:07.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.398+0000 7f4e9cc09ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T14:20:07.396 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.398+0000 7f4e9cc09ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=612 2019-11-25T14:20:07.405 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.408+0000 7f4e6affd700 10 RGWWatcher::handle_notify() notify_id 588410520121 cookie 94911763020992 notifier 5076 bl.length()=612 2019-11-25T14:20:07.405 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.408+0000 7f4e6affd700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-25T14:20:07.406 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.408+0000 7f4e6affd700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T14:20:07.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.723+0000 7f4e9cc09ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-25T14:20:07.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.723+0000 7f4e9cc09ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-25T14:20:07.720 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.723+0000 7f4e9cc09ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-11-25T14:20:07.733 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.735+0000 7f4e6affd700 10 RGWWatcher::handle_notify() notify_id 588410519664 cookie 94911763037088 notifier 5076 bl.length()=194 2019-11-25T14:20:07.733 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.735+0000 7f4e6affd700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-11-25T14:20:07.734 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.735+0000 7f4e6affd700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-11-25T14:20:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.834+0000 7f4e9cc09ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-25T14:20:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.834+0000 7f4e9cc09ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-25T14:20:07.832 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.834+0000 7f4e9cc09ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=183 2019-11-25T14:20:07.846 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.848+0000 7f4e6affd700 10 RGWWatcher::handle_notify() notify_id 588410519718 cookie 94911763024256 notifier 5076 bl.length()=183 2019-11-25T14:20:07.846 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.848+0000 7f4e6affd700 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-11-25T14:20:07.846 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:07.848+0000 7f4e6affd700 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-11-25T14:20:08.135 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.131+0000 7f4e9cc09ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-25T14:20:08.136 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.131+0000 7f4e9cc09ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T14:20:08.136 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.131+0000 7f4e9cc09ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-11-25T14:20:08.148 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.151+0000 7f4e6affd700 10 RGWWatcher::handle_notify() notify_id 588410520122 cookie 94911763020992 notifier 5076 bl.length()=636 2019-11-25T14:20:08.148 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.151+0000 7f4e6affd700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-11-25T14:20:08.149 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.151+0000 7f4e6affd700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-11-25T14:20:08.240 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2019-11-25T14:20:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "user_id": "foo.client.0", 2019-11-25T14:20:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "display_name": "Mr. foo.client.0 foo", 2019-11-25T14:20:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "email": "foo.client.0+test@test.test", 2019-11-25T14:20:08.240 INFO:teuthology.orchestra.run.smithi135.stdout: "suspended": 0, 2019-11-25T14:20:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "max_buckets": 1000, 2019-11-25T14:20:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "subusers": [ 2019-11-25T14:20:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: { 2019-11-25T14:20:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "id": "foo.client.0:foo", 2019-11-25T14:20:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: "permissions": "full-control" 2019-11-25T14:20:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: } 2019-11-25T14:20:08.241 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2019-11-25T14:20:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "keys": [], 2019-11-25T14:20:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "swift_keys": [ 2019-11-25T14:20:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: { 2019-11-25T14:20:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "user": "foo.client.0:foo", 2019-11-25T14:20:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: "secret_key": "/rDV//tGidkqhbcQLGLYLjrBzylLSX3cfssL92lR29elyZKwwUJMjw==" 2019-11-25T14:20:08.242 INFO:teuthology.orchestra.run.smithi135.stdout: } 2019-11-25T14:20:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2019-11-25T14:20:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": [], 2019-11-25T14:20:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "op_mask": "read, write, delete", 2019-11-25T14:20:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "default_placement": "", 2019-11-25T14:20:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "default_storage_class": "", 2019-11-25T14:20:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "placement_tags": [], 2019-11-25T14:20:08.243 INFO:teuthology.orchestra.run.smithi135.stdout: "bucket_quota": { 2019-11-25T14:20:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T14:20:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T14:20:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T14:20:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T14:20:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T14:20:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T14:20:08.244 INFO:teuthology.orchestra.run.smithi135.stdout: "user_quota": { 2019-11-25T14:20:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T14:20:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T14:20:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T14:20:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T14:20:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T14:20:08.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T14:20:08.246 INFO:teuthology.orchestra.run.smithi135.stdout: "temp_url_keys": [], 2019-11-25T14:20:08.246 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "rgw", 2019-11-25T14:20:08.246 INFO:teuthology.orchestra.run.smithi135.stdout: "mfa_ids": [] 2019-11-25T14:20:08.246 INFO:teuthology.orchestra.run.smithi135.stdout:} 2019-11-25T14:20:08.246 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T14:20:08.276 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.279+0000 7f4e9cc09ec0 20 remove_watcher() i=0 2019-11-25T14:20:08.277 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.279+0000 7f4e9cc09ec0 2 removed watcher, disabling cache 2019-11-25T14:20:08.341 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.343+0000 7f4e9cc09ec0 20 remove_watcher() i=1 2019-11-25T14:20:08.392 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.395+0000 7f4e9cc09ec0 20 remove_watcher() i=2 2019-11-25T14:20:08.459 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.461+0000 7f4e9cc09ec0 20 remove_watcher() i=3 2019-11-25T14:20:08.503 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.505+0000 7f4e9cc09ec0 20 remove_watcher() i=4 2019-11-25T14:20:08.566 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.568+0000 7f4e9cc09ec0 20 remove_watcher() i=5 2019-11-25T14:20:08.637 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.640+0000 7f4e9cc09ec0 20 remove_watcher() i=6 2019-11-25T14:20:08.688 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.690+0000 7f4e9cc09ec0 20 remove_watcher() i=7 2019-11-25T14:20:08.698 INFO:teuthology.orchestra.run.smithi135:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser bar.client.0:bar --display-name 'Mr. bar.client.0 bar' --secret dW1CDISMSZNGkS0sD7bm70/ws62MQzu/Q06i6GMkXmDQnX6xPXL1MA== --email bar.client.0+test@test.test --key-type swift --access full 2019-11-25T14:20:08.827 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.829+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:08.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.855+0000 7fc9c48feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:08.853 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.855+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:08.861 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.864+0000 7fc9c48feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:08.861 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.864+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:08.869 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.872+0000 7fc9c48feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:08.869 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.872+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:08.890 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:08.893+0000 7fc9c48feec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:20:09.063 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.066+0000 7fc9c48feec0 20 RGWRados::pool_iterate: got zone_info.b9020152-a9a6-4198-abf1-1fb1ecbb8573 2019-11-25T14:20:09.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.066+0000 7fc9c48feec0 20 RGWRados::pool_iterate: got zonegroup_info.b471f829-437f-467d-ac64-93b4f60f0de6 2019-11-25T14:20:09.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.066+0000 7fc9c48feec0 20 RGWRados::pool_iterate: got zone_names.default 2019-11-25T14:20:09.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.066+0000 7fc9c48feec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-11-25T14:20:09.064 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.066+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.082 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.085+0000 7fc9c48feec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:20:09.083 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.085+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.099 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.102+0000 7fc9c48feec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T14:20:09.100 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.102+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.113 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.116+0000 7fc9c48feec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:20:09.113 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.116+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.130+0000 7fc9c48feec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T14:20:09.128 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.130+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.138 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.141+0000 7fc9c48feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:09.138 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.141+0000 7fc9c48feec0 10 cannot find current period zonegroup using local zonegroup 2019-11-25T14:20:09.138 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.141+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.147 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.149+0000 7fc9c48feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:09.147 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.149+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.164+0000 7fc9c48feec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:20:09.162 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.164+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.177+0000 7fc9c48feec0 20 rados_obj.operate() r=0 bl.length=382 2019-11-25T14:20:09.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.177+0000 7fc9c48feec0 20 zonegroup default 2019-11-25T14:20:09.175 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.177+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.184 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.186+0000 7fc9c48feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:09.184 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.186+0000 7fc9c48feec0 10 Cannot find current period zone using local zone 2019-11-25T14:20:09.184 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.186+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.192 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.195+0000 7fc9c48feec0 20 rados_obj.operate() r=-2 bl.length=0 2019-11-25T14:20:09.193 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.195+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.209 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.212+0000 7fc9c48feec0 20 rados_obj.operate() r=0 bl.length=46 2019-11-25T14:20:09.209 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.212+0000 7fc9c48feec0 20 rados->read ofs=0 len=0 2019-11-25T14:20:09.227 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.229+0000 7fc9c48feec0 20 rados_obj.operate() r=0 bl.length=951 2019-11-25T14:20:09.227 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.229+0000 7fc9c48feec0 20 zone default found 2019-11-25T14:20:09.227 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.229+0000 7fc9c48feec0 20 started sync module instance, tier type = 2019-11-25T14:20:09.228 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.229+0000 7fc9c48feec0 20 started zone id=b9020152-a9a6-4198-abf1-1fb1ecbb8573 (name=default) with tier type = 2019-11-25T14:20:09.600 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.602+0000 7fc9c48feec0 20 add_watcher() i=0 2019-11-25T14:20:09.600 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.602+0000 7fc9c48feec0 20 add_watcher() i=1 2019-11-25T14:20:09.600 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.602+0000 7fc9c48feec0 20 add_watcher() i=2 2019-11-25T14:20:09.600 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.602+0000 7fc9c48feec0 20 add_watcher() i=3 2019-11-25T14:20:09.600 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.602+0000 7fc9c48feec0 20 add_watcher() i=4 2019-11-25T14:20:09.601 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.602+0000 7fc9c48feec0 20 add_watcher() i=5 2019-11-25T14:20:09.601 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.602+0000 7fc9c48feec0 20 add_watcher() i=6 2019-11-25T14:20:09.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.640+0000 7fc9c48feec0 20 add_watcher() i=7 2019-11-25T14:20:09.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.640+0000 7fc9c48feec0 2 all 8 watchers are set, enabling cache 2019-11-25T14:20:09.638 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.641+0000 7fc9827dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-11-25T14:20:09.653 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.655+0000 7fc9b132b700 0 -- 172.21.15.135:0/1972543389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0c48fd580 msgr2=0x55b0c48ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T14:20:09.680 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:09.683+0000 7fc9b1b2c700 0 -- 172.21.15.135:0/3173588101 >> [v2:172.21.15.135:3301/0,v1:172.21.15.135:6790/0] conn(0x55b0c48fd1b0 msgr2=0x55b0c4901c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-11-25T14:20:11.587 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.589+0000 7fc8f8ff9700 20 reqs_thread_entry: start 2019-11-25T14:20:11.587 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.590+0000 7fc8f27fc700 20 reqs_thread_entry: start 2019-11-25T14:20:11.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.590+0000 7fc9c48feec0 20 init_complete bucket index max shards: 0 2019-11-25T14:20:11.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.591+0000 7fc8f0ff9700 20 reqs_thread_entry: start 2019-11-25T14:20:11.588 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.591+0000 7fc9c48feec0 20 get_system_obj_state: rctx=0x7ffcec5bb358 obj=default.rgw.meta:users.uid:bar.client.0 state=0x55b0c4974130 s->prefetch_data=0 2019-11-25T14:20:11.589 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.591+0000 7fc9c48feec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-11-25T14:20:11.597 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.599+0000 7fc9c48feec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-11-25T14:20:11.597 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.599+0000 7fc9c48feec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T14:20:11.597 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.600+0000 7fc9c48feec0 20 get_system_obj_state: rctx=0x7ffcec5bb368 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x55b0c4975ec0 s->prefetch_data=0 2019-11-25T14:20:11.597 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.600+0000 7fc9c48feec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-11-25T14:20:11.603 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.606+0000 7fc9c48feec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-11-25T14:20:11.603 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.606+0000 7fc9c48feec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-25T14:20:11.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.606+0000 7fc9c48feec0 20 get_system_obj_state: rctx=0x7ffcec5baf78 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x55b0c4975ec0 s->prefetch_data=0 2019-11-25T14:20:11.604 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.606+0000 7fc9c48feec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : miss 2019-11-25T14:20:11.612 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.615+0000 7fc9c48feec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-25T14:20:11.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.615+0000 7fc9c48feec0 10 adding default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-25T14:20:11.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.615+0000 7fc9c48feec0 20 get_system_obj_state: rctx=0x7ffcec5bb0f8 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x55b0c4976170 s->prefetch_data=0 2019-11-25T14:20:11.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.615+0000 7fc9c48feec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : type miss (requested=0x6, cached=0x0) 2019-11-25T14:20:11.619 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.622+0000 7fc9c48feec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-11-25T14:20:11.619 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.622+0000 7fc9c48feec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-25T14:20:11.660 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.663+0000 7fc9c48feec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-25T14:20:11.661 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.663+0000 7fc9c48feec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T14:20:11.661 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.663+0000 7fc9c48feec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=612 2019-11-25T14:20:11.672 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.674+0000 7fc992ffd700 10 RGWWatcher::handle_notify() notify_id 588410519719 cookie 94217700272512 notifier 5091 bl.length()=612 2019-11-25T14:20:11.672 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.675+0000 7fc992ffd700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-25T14:20:11.672 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:11.675+0000 7fc992ffd700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T14:20:12.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:12.943+0000 7fc9c48feec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-25T14:20:12.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:12.943+0000 7fc9c48feec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-25T14:20:12.941 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:12.943+0000 7fc9c48feec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-11-25T14:20:12.953 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:12.956+0000 7fc992ffd700 10 RGWWatcher::handle_notify() notify_id 588410519720 cookie 94217700272512 notifier 5091 bl.length()=194 2019-11-25T14:20:12.953 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:12.956+0000 7fc992ffd700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-11-25T14:20:12.954 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:12.956+0000 7fc992ffd700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-11-25T14:20:13.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.098+0000 7fc9c48feec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-25T14:20:13.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.098+0000 7fc9c48feec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-25T14:20:13.095 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.098+0000 7fc9c48feec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=183 2019-11-25T14:20:13.105 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.108+0000 7fc992ffd700 10 RGWWatcher::handle_notify() notify_id 588410519721 cookie 94217700283040 notifier 5091 bl.length()=183 2019-11-25T14:20:13.106 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.108+0000 7fc992ffd700 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-11-25T14:20:13.106 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.108+0000 7fc992ffd700 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-11-25T14:20:13.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.614+0000 7fc9c48feec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-25T14:20:13.613 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.614+0000 7fc9c48feec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T14:20:13.614 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.614+0000 7fc9c48feec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-11-25T14:20:13.627 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.630+0000 7fc992ffd700 10 RGWWatcher::handle_notify() notify_id 588410519722 cookie 94217700272512 notifier 5091 bl.length()=636 2019-11-25T14:20:13.627 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.630+0000 7fc992ffd700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-11-25T14:20:13.628 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.630+0000 7fc992ffd700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-11-25T14:20:13.728 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2019-11-25T14:20:13.728 INFO:teuthology.orchestra.run.smithi135.stdout: "user_id": "bar.client.0", 2019-11-25T14:20:13.728 INFO:teuthology.orchestra.run.smithi135.stdout: "display_name": "Mr. bar.client.0 bar", 2019-11-25T14:20:13.728 INFO:teuthology.orchestra.run.smithi135.stdout: "email": "bar.client.0+test@test.test", 2019-11-25T14:20:13.729 INFO:teuthology.orchestra.run.smithi135.stdout: "suspended": 0, 2019-11-25T14:20:13.729 INFO:teuthology.orchestra.run.smithi135.stdout: "max_buckets": 1000, 2019-11-25T14:20:13.729 INFO:teuthology.orchestra.run.smithi135.stdout: "subusers": [ 2019-11-25T14:20:13.729 INFO:teuthology.orchestra.run.smithi135.stdout: { 2019-11-25T14:20:13.729 INFO:teuthology.orchestra.run.smithi135.stdout: "id": "bar.client.0:bar", 2019-11-25T14:20:13.729 INFO:teuthology.orchestra.run.smithi135.stdout: "permissions": "full-control" 2019-11-25T14:20:13.729 INFO:teuthology.orchestra.run.smithi135.stdout: } 2019-11-25T14:20:13.730 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2019-11-25T14:20:13.730 INFO:teuthology.orchestra.run.smithi135.stdout: "keys": [], 2019-11-25T14:20:13.730 INFO:teuthology.orchestra.run.smithi135.stdout: "swift_keys": [ 2019-11-25T14:20:13.730 INFO:teuthology.orchestra.run.smithi135.stdout: { 2019-11-25T14:20:13.730 INFO:teuthology.orchestra.run.smithi135.stdout: "user": "bar.client.0:bar", 2019-11-25T14:20:13.730 INFO:teuthology.orchestra.run.smithi135.stdout: "secret_key": "dW1CDISMSZNGkS0sD7bm70/ws62MQzu/Q06i6GMkXmDQnX6xPXL1MA==" 2019-11-25T14:20:13.730 INFO:teuthology.orchestra.run.smithi135.stdout: } 2019-11-25T14:20:13.731 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2019-11-25T14:20:13.731 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": [], 2019-11-25T14:20:13.731 INFO:teuthology.orchestra.run.smithi135.stdout: "op_mask": "read, write, delete", 2019-11-25T14:20:13.731 INFO:teuthology.orchestra.run.smithi135.stdout: "default_placement": "", 2019-11-25T14:20:13.731 INFO:teuthology.orchestra.run.smithi135.stdout: "default_storage_class": "", 2019-11-25T14:20:13.731 INFO:teuthology.orchestra.run.smithi135.stdout: "placement_tags": [], 2019-11-25T14:20:13.731 INFO:teuthology.orchestra.run.smithi135.stdout: "bucket_quota": { 2019-11-25T14:20:13.732 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T14:20:13.732 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T14:20:13.732 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T14:20:13.732 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T14:20:13.732 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T14:20:13.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T14:20:13.733 INFO:teuthology.orchestra.run.smithi135.stdout: "user_quota": { 2019-11-25T14:20:13.733 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": false, 2019-11-25T14:20:13.733 INFO:teuthology.orchestra.run.smithi135.stdout: "check_on_raw": false, 2019-11-25T14:20:13.733 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size": -1, 2019-11-25T14:20:13.733 INFO:teuthology.orchestra.run.smithi135.stdout: "max_size_kb": 0, 2019-11-25T14:20:13.733 INFO:teuthology.orchestra.run.smithi135.stdout: "max_objects": -1 2019-11-25T14:20:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2019-11-25T14:20:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: "temp_url_keys": [], 2019-11-25T14:20:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "rgw", 2019-11-25T14:20:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: "mfa_ids": [] 2019-11-25T14:20:13.734 INFO:teuthology.orchestra.run.smithi135.stdout:} 2019-11-25T14:20:13.734 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T14:20:13.790 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.792+0000 7fc9c48feec0 20 remove_watcher() i=0 2019-11-25T14:20:13.790 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.792+0000 7fc9c48feec0 2 removed watcher, disabling cache 2019-11-25T14:20:13.828 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.830+0000 7fc9c48feec0 20 remove_watcher() i=1 2019-11-25T14:20:13.887 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.890+0000 7fc9c48feec0 20 remove_watcher() i=2 2019-11-25T14:20:13.930 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.933+0000 7fc9c48feec0 20 remove_watcher() i=3 2019-11-25T14:20:13.978 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:13.980+0000 7fc9c48feec0 20 remove_watcher() i=4 2019-11-25T14:20:14.031 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:14.033+0000 7fc9c48feec0 20 remove_watcher() i=5 2019-11-25T14:20:14.074 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:14.077+0000 7fc9c48feec0 20 remove_watcher() i=6 2019-11-25T14:20:14.112 INFO:teuthology.orchestra.run.smithi135.stderr:2019-11-25T14:20:14.115+0000 7fc9c48feec0 20 remove_watcher() i=7 2019-11-25T14:20:14.121 INFO:tasks.swift:Configuring testswift... 2019-11-25T14:20:14.121 INFO:teuthology.orchestra.run.smithi135:> cd /home/ubuntu/cephtest/swift && ./bootstrap 2019-11-25T14:20:16.678 INFO:teuthology.orchestra.run.smithi135.stdout:New python executable in /home/ubuntu/cephtest/swift/virtualenv/bin/python 2019-11-25T14:20:17.947 INFO:teuthology.orchestra.run.smithi135.stdout:Installing setuptools, pip, wheel...done. 2019-11-25T14:20:18.225 INFO:teuthology.orchestra.run.smithi135.stderr:Cache entry deserialization failed, entry ignored 2019-11-25T14:20:18.366 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting pip 2019-11-25T14:20:18.453 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-11-25T14:20:18.520 INFO:teuthology.orchestra.run.smithi135.stdout:Installing collected packages: pip 2019-11-25T14:20:18.520 INFO:teuthology.orchestra.run.smithi135.stdout: Found existing installation: pip 9.0.1 2019-11-25T14:20:18.579 INFO:teuthology.orchestra.run.smithi135.stdout: Uninstalling pip-9.0.1: 2019-11-25T14:20:18.622 INFO:teuthology.orchestra.run.smithi135.stdout: Successfully uninstalled pip-9.0.1 2019-11-25T14:20:19.321 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully installed pip-19.3.1 2019-11-25T14:20:19.677 INFO:teuthology.orchestra.run.smithi135.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-25T14:20:20.207 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting setuptools==32.3.1 2019-11-25T14:20:20.209 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-11-25T14:20:20.248 INFO:teuthology.orchestra.run.smithi135.stdout:Installing collected packages: setuptools 2019-11-25T14:20:20.248 INFO:teuthology.orchestra.run.smithi135.stdout: Found existing installation: setuptools 28.8.0 2019-11-25T14:20:20.263 INFO:teuthology.orchestra.run.smithi135.stdout: Uninstalling setuptools-28.8.0: 2019-11-25T14:20:20.282 INFO:teuthology.orchestra.run.smithi135.stdout: Successfully uninstalled setuptools-28.8.0 2019-11-25T14:20:20.394 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully installed setuptools-32.3.1 2019-11-25T14:20:20.847 INFO:teuthology.orchestra.run.smithi135.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-11-25T14:20:21.090 INFO:teuthology.orchestra.run.smithi135.stdout:Processing /home/ubuntu/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl 2019-11-25T14:20:21.172 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting nose>=1.0.0 2019-11-25T14:20:21.175 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-11-25T14:20:21.314 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting boto>=2.0b4 2019-11-25T14:20:21.321 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-11-25T14:20:21.467 INFO:teuthology.orchestra.run.smithi135.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-11-25T14:20:21.719 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting gevent>=0.14 2019-11-25T14:20:21.734 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-25T14:20:21.974 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting isodate>=0.4.4 2019-11-25T14:20:21.975 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl 2019-11-25T14:20:22.064 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting eventlet>=0.9.14 2019-11-25T14:20:22.107 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/ef/01/83454d11bac9015f34e93cf11efcae169390ddf2df97cb73ca86de6465ed/eventlet-0.25.1-py2.py3-none-any.whl (222kB) 2019-11-25T14:20:22.280 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting netifaces>=0.5 2019-11-25T14:20:22.291 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/7e/02/ad1a92a72620cc17d448fe4dbdfbdf8fe1487ee7bfd82bb48308712c2f3c/netifaces-0.10.9-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-25T14:20:22.399 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting xattr<0.7.0,>=0.6 2019-11-25T14:20:22.411 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/c5/80/b25d549ae4bf4f3e9635a331b759ffca2de4dd8a78dc5106d1ca92f5d08d/xattr-0.6.4.tar.gz 2019-11-25T14:20:22.823 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting simplejson>=2.1.3 2019-11-25T14:20:22.833 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz (83kB) 2019-11-25T14:20:23.184 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting WebOb==1.0 2019-11-25T14:20:23.195 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/bc/eb/91b8dd8f3a8d3c3943bf27a2d322501ad8b227bf29f59e792c2eae092bc9/WebOb-1.0.tar.gz (210kB) 2019-11-25T14:20:23.778 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-11-25T14:20:23.781 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-11-25T14:20:23.858 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting six 2019-11-25T14:20:23.860 INFO:teuthology.orchestra.run.smithi135.stdout: Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-11-25T14:20:23.921 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting monotonic>=1.4 2019-11-25T14:20:23.932 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl 2019-11-25T14:20:24.011 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting dnspython>=1.15.0 2019-11-25T14:20:24.022 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/ec/d3/3aa0e7213ef72b8585747aa0e271a9523e713813b9a20177ebe1e939deb0/dnspython-1.16.0-py2.py3-none-any.whl (188kB) 2019-11-25T14:20:24.155 INFO:teuthology.orchestra.run.smithi135.stdout:Collecting enum34; python_version < "3.4" 2019-11-25T14:20:24.166 INFO:teuthology.orchestra.run.smithi135.stdout: Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl 2019-11-25T14:20:24.204 INFO:teuthology.orchestra.run.smithi135.stdout:Building wheels for collected packages: xattr, simplejson, WebOb 2019-11-25T14:20:24.205 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for xattr (setup.py): started 2019-11-25T14:20:24.666 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for xattr (setup.py): finished with status 'done' 2019-11-25T14:20:24.667 INFO:teuthology.orchestra.run.smithi135.stdout: Created wheel for xattr: filename=xattr-0.6.4-cp27-cp27mu-linux_x86_64.whl size=24118 sha256=4507c7d67fc60c5c2db3f7b32941272ede63b4303ed67dc72256bdbaf0ce645b 2019-11-25T14:20:24.667 INFO:teuthology.orchestra.run.smithi135.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/cb/2c/40/ea48345a21b521cdacebf61db13e3bf0c42c77ec664e3fe9e5 2019-11-25T14:20:24.675 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for simplejson (setup.py): started 2019-11-25T14:20:25.716 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for simplejson (setup.py): finished with status 'done' 2019-11-25T14:20:25.717 INFO:teuthology.orchestra.run.smithi135.stdout: Created wheel for simplejson: filename=simplejson-3.17.0-cp27-cp27mu-linux_x86_64.whl size=113118 sha256=4ee1f4c37dbde6766c18b7050f346d021c42fc374ce6e148e627519f5bcb1c80 2019-11-25T14:20:25.717 INFO:teuthology.orchestra.run.smithi135.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/86/c0/83/dcd0339abb2640544bb8e0938aab2d069cef55e5647ce6e097 2019-11-25T14:20:25.732 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for WebOb (setup.py): started 2019-11-25T14:20:26.007 INFO:teuthology.orchestra.run.smithi135.stdout: Building wheel for WebOb (setup.py): finished with status 'done' 2019-11-25T14:20:26.007 INFO:teuthology.orchestra.run.smithi135.stdout: Created wheel for WebOb: filename=WebOb-1.0-cp27-none-any.whl size=58478 sha256=c72d8ed65bacad12d757420f1168308b0a21c157b58c6872f881028ab5a8c6a2 2019-11-25T14:20:26.008 INFO:teuthology.orchestra.run.smithi135.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/30/41/c0/8ff9e679d72e05f355e6e2ec87d026131538c953a3b12496eb 2019-11-25T14:20:26.021 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully built xattr simplejson WebOb 2019-11-25T14:20:26.093 INFO:teuthology.orchestra.run.smithi135.stdout:Installing collected packages: PyYAML, nose, boto, bunch, greenlet, gevent, six, isodate, monotonic, dnspython, enum34, eventlet, netifaces, xattr, simplejson, WebOb 2019-11-25T14:20:27.586 INFO:teuthology.orchestra.run.smithi135.stdout:Successfully installed PyYAML-5.1.2 WebOb-1.0 boto-2.49.0 bunch-1.0.1 dnspython-1.16.0 enum34-1.1.6 eventlet-0.25.1 gevent-1.4.0 greenlet-0.4.15 isodate-0.6.0 monotonic-1.5 netifaces-0.10.9 nose-1.3.7 simplejson-3.17.0 six-1.13.0 xattr-0.6.4 2019-11-25T14:20:27.913 INFO:teuthology.orchestra.run.smithi135.stdout:running develop 2019-11-25T14:20:27.959 INFO:teuthology.orchestra.run.smithi135.stdout:running egg_info 2019-11-25T14:20:27.959 INFO:teuthology.orchestra.run.smithi135.stdout:creating swift.egg-info 2019-11-25T14:20:27.959 INFO:teuthology.orchestra.run.smithi135.stdout:writing swift.egg-info/PKG-INFO 2019-11-25T14:20:27.960 INFO:teuthology.orchestra.run.smithi135.stdout:writing top-level names to swift.egg-info/top_level.txt 2019-11-25T14:20:27.960 INFO:teuthology.orchestra.run.smithi135.stdout:writing dependency_links to swift.egg-info/dependency_links.txt 2019-11-25T14:20:27.964 INFO:teuthology.orchestra.run.smithi135.stdout:writing entry points to swift.egg-info/entry_points.txt 2019-11-25T14:20:27.964 INFO:teuthology.orchestra.run.smithi135.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-25T14:20:27.967 INFO:teuthology.orchestra.run.smithi135.stdout:reading manifest file 'swift.egg-info/SOURCES.txt' 2019-11-25T14:20:27.968 INFO:teuthology.orchestra.run.smithi135.stdout:reading manifest template 'MANIFEST.in' 2019-11-25T14:20:27.968 INFO:teuthology.orchestra.run.smithi135.stderr:warning: no files found matching 'ChangeLog' 2019-11-25T14:20:27.971 INFO:teuthology.orchestra.run.smithi135.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-11-25T14:20:27.972 INFO:teuthology.orchestra.run.smithi135.stdout:running build_ext 2019-11-25T14:20:27.973 INFO:teuthology.orchestra.run.smithi135.stdout:Creating /home/ubuntu/cephtest/swift/virtualenv/lib/python2.7/site-packages/swift.egg-link (link to .) 2019-11-25T14:20:27.973 INFO:teuthology.orchestra.run.smithi135.stdout:Adding swift 1.4.4 to easy-install.pth file 2019-11-25T14:20:27.989 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:27.990 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-account-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:27.992 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-account-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:27.993 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-account-reaper script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:27.994 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-account-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:27.995 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-account-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:27.996 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-container-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:27.996 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-container-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:27.997 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-container-sync script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:27.998 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-container-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:27.999 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-container-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.000 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-drive-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.001 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-get-nodes script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.002 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-init script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.003 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-object-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.004 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-object-expirer script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.005 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-object-info script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.006 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-object-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.007 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-object-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.007 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-object-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.008 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-proxy-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.012 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-ring-builder script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.014 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-stats-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.020 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-stats-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.021 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-dispersion-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.023 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-dispersion-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.024 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-bench script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.027 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-recon script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.028 INFO:teuthology.orchestra.run.smithi135.stdout:Installing swift-recon-cron script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-11-25T14:20:28.028 INFO:teuthology.orchestra.run.smithi135.stdout: 2019-11-25T14:20:28.028 INFO:teuthology.orchestra.run.smithi135.stdout:Installed /home/ubuntu/cephtest/swift 2019-11-25T14:20:28.029 INFO:teuthology.orchestra.run.smithi135.stdout:Processing dependencies for swift==1.4.4 2019-11-25T14:20:28.029 INFO:teuthology.orchestra.run.smithi135.stdout:Finished processing dependencies for swift==1.4.4 2019-11-25T14:20:28.041 INFO:teuthology.orchestra.run.smithi135:> cat > /home/ubuntu/cephtest/archive/testswift.client.0.conf 2019-11-25T14:20:28.099 INFO:teuthology.orchestra.run.smithi135:> SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw' 2019-11-25T14:21:05.470 INFO:teuthology.orchestra.run.smithi135.stderr:testAccountHead (test.functional.tests.TestAccount) ... ok 2019-11-25T14:21:24.304 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerListing (test.functional.tests.TestAccount) ... ok 2019-11-25T14:21:44.084 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:56:57.235 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:21:44.090 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:56:57.241 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:21:44.099 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:56:57.250 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:21:44.102 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:56:57.253 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:21:44.104 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:56:57.355 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:21:44.114 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:56:57.365 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:21:44.217 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:04:56:57.368 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:21:44.270 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:04:56:57.421 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:21:44.299 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:04:56:57.550 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:25:33.043 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerSerializedInfo (test.functional.tests.TestAccount) ... ok 2019-11-25T14:25:53.492 INFO:teuthology.orchestra.run.smithi135.stderr:testContainersOrderedByName (test.functional.tests.TestAccount) ... ok 2019-11-25T14:25:54.632 INFO:teuthology.orchestra.run.smithi135.stderr:testInvalidAuthToken (test.functional.tests.TestAccount) ... ok 2019-11-25T14:26:18.628 INFO:teuthology.orchestra.run.smithi135.stderr:testLastContainerMarker (test.functional.tests.TestAccount) ... ok 2019-11-25T14:26:43.037 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:01:56.188 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:43.074 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:01:56.224 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:43.089 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:01:56.240 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:43.091 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:01:56.342 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:43.093 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:01:56.344 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:43.098 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:01:56.249 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:43.224 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:01:56.375 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:43.226 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:01:56.477 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:43.281 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:01:56.432 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:46.103 INFO:teuthology.orchestra.run.smithi135.stderr:testListingLimit (test.functional.tests.TestAccount) ... ok 2019-11-25T14:26:54.138 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:02:07.289 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:54.145 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:02:07.296 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:54.152 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:02:07.303 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:54.156 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:02:07.307 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:54.168 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:02:07.420 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:54.169 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:02:07.320 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:54.175 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:02:07.427 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:54.182 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:02:07.333 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:26:54.234 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:02:07.485 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:27:52.767 INFO:teuthology.orchestra.run.smithi135.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccount) ... ok 2019-11-25T14:27:52.830 INFO:teuthology.orchestra.run.smithi135.stderr:testPUT (test.functional.tests.TestAccount) ... ok 2019-11-25T14:31:04.022 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:06:17.172 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:31:04.033 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:06:17.184 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:31:04.093 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:06:17.244 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:31:04.114 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:06:17.265 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:31:04.126 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:06:17.378 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:31:04.136 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:06:17.388 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:31:04.288 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:06:17.439 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:31:04.314 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:06:17.465 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:31:04.376 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:06:17.628 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:32:08.149 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:07:21.300 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:32:08.157 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:07:21.308 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:32:08.163 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:07:21.314 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:32:08.167 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:07:21.318 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:32:08.169 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:07:21.421 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:32:08.175 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:07:21.427 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:32:08.217 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:07:21.368 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:32:08.237 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:07:21.388 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:32:08.259 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:07:21.511 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:34:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:testGetRequest (test.functional.tests.TestAccountNoContainers) ... ok 2019-11-25T14:34:10.135 INFO:teuthology.orchestra.run.smithi135.stderr:testGetRequest (test.functional.tests.TestAccountNoContainersUTF8) ... ok 2019-11-25T14:34:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:testAccountHead (test.functional.tests.TestAccountUTF8) ... ok 2019-11-25T14:35:04.724 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:10:17.875 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:35:04.772 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:10:17.922 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:35:04.790 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:10:18.042 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:35:04.792 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:10:18.044 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:35:04.796 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:10:17.947 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:35:04.810 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:10:17.961 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:35:04.854 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:10:18.005 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:35:04.885 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:10:18.036 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:35:04.888 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:10:18.140 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:35:07.280 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerListing (test.functional.tests.TestAccountUTF8) ... ok 2019-11-25T14:37:18.345 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:12:31.496 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:37:18.352 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:12:31.503 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:37:18.358 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:12:31.509 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:37:18.361 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:12:31.612 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:37:18.366 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:12:31.517 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:37:18.368 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:12:31.620 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:37:18.458 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:12:31.609 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:37:18.479 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:12:31.630 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:37:18.487 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:12:31.738 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:40:07.663 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerSerializedInfo (test.functional.tests.TestAccountUTF8) ... ok 2019-11-25T14:40:26.777 INFO:teuthology.orchestra.run.smithi135.stderr:testContainersOrderedByName (test.functional.tests.TestAccountUTF8) ... ok 2019-11-25T14:40:28.540 INFO:teuthology.orchestra.run.smithi135.stderr:testInvalidAuthToken (test.functional.tests.TestAccountUTF8) ... ok 2019-11-25T14:40:48.591 INFO:teuthology.orchestra.run.smithi135.stderr:testLastContainerMarker (test.functional.tests.TestAccountUTF8) ... ok 2019-11-25T14:41:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:testListingLimit (test.functional.tests.TestAccountUTF8) ... ok 2019-11-25T14:42:30.515 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:17:43.666 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:42:30.522 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:17:43.673 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:42:30.532 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:17:43.683 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:42:30.536 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:17:43.687 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:42:30.540 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:17:43.791 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:42:30.544 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:17:43.796 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:42:30.705 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:17:43.856 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:42:30.767 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:17:43.918 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:42:30.776 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:17:44.028 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:43:26.462 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:18:39.613 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:43:26.482 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:18:39.633 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:43:26.497 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:18:39.749 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:43:26.499 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:18:39.650 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:43:26.508 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:18:39.659 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:43:26.537 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:18:39.688 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:43:26.550 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:18:39.802 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:43:26.562 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:18:39.713 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:43:26.598 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:18:39.850 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:43:34.707 INFO:teuthology.orchestra.run.smithi135.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccountUTF8) ... ok 2019-11-25T14:43:34.955 INFO:teuthology.orchestra.run.smithi135.stderr:testPUT (test.functional.tests.TestAccountUTF8) ... ok 2019-11-25T14:47:42.182 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:22:55.332 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:47:42.187 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:22:55.336 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:47:42.199 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:22:55.349 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:47:42.202 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:22:55.352 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:47:42.215 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:22:55.466 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:47:42.231 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:22:55.483 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:47:42.355 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:22:55.506 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:47:42.380 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:22:55.531 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:47:42.480 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:22:55.732 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:51:45.245 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainer) ... ok 2019-11-25T14:51:47.868 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:27:01.018 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:51:47.898 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:27:01.048 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:51:47.907 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:27:01.058 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:51:47.916 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:27:01.066 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:51:47.946 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:27:01.198 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:51:47.949 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:27:01.200 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:51:48.006 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:27:01.156 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:51:48.025 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:27:01.175 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:51:48.123 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:27:01.374 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:51:49.168 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerFileList (test.functional.tests.TestContainer) ... ok 2019-11-25T14:51:50.258 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-25T14:51:54.264 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainer) ... ok 2019-11-25T14:51:54.663 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerInfo (test.functional.tests.TestContainer) ... ok 2019-11-25T14:51:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-25T14:52:07.984 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerNameLimit (test.functional.tests.TestContainer) ... ok 2019-11-25T14:52:19.025 INFO:teuthology.orchestra.run.smithi135.stderr:testCreate (test.functional.tests.TestContainer) ... ok 2019-11-25T14:52:35.987 INFO:teuthology.orchestra.run.smithi135.stderr:testDelete (test.functional.tests.TestContainer) ... ok 2019-11-25T14:52:36.049 INFO:teuthology.orchestra.run.smithi135.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-25T14:52:44.435 INFO:teuthology.orchestra.run.smithi135.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainer) ... ok 2019-11-25T14:52:44.837 INFO:teuthology.orchestra.run.smithi135.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-11-25T14:52:51.135 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:28:04.285 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:52:51.148 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:28:04.299 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:52:51.156 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:28:04.406 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:52:51.159 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:28:04.411 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:52:51.160 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:28:04.310 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:52:51.164 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:28:04.315 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:52:51.213 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:28:04.363 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:52:51.241 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:28:04.391 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:52:51.280 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:28:04.532 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:54:30.140 INFO:teuthology.orchestra.run.smithi135.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainer) ... ok 2019-11-25T14:54:34.862 INFO:teuthology.orchestra.run.smithi135.stderr:testFileOrder (test.functional.tests.TestContainer) ... ok 2019-11-25T14:54:58.971 INFO:teuthology.orchestra.run.smithi135.stderr:testFileThenContainerDelete (test.functional.tests.TestContainer) ... ok 2019-11-25T14:55:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:testLastFileMarker (test.functional.tests.TestContainer) ... ok 2019-11-25T14:55:54.163 INFO:teuthology.orchestra.run.smithi135.stderr:testMarkerLimitFileList (test.functional.tests.TestContainer) ... ok 2019-11-25T14:57:05.880 INFO:teuthology.orchestra.run.smithi135.stderr:testPrefixAndLimit (test.functional.tests.TestContainer) ... ok 2019-11-25T14:57:05.937 INFO:teuthology.orchestra.run.smithi135.stderr:testTooLongName (test.functional.tests.TestContainer) ... ok 2019-11-25T14:58:03.969 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:33:17.119 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:58:03.989 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:33:17.139 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:58:04.002 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:33:17.253 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:58:04.003 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:33:17.153 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:58:04.019 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:33:17.169 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:58:04.022 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:33:17.274 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:58:04.211 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:33:17.463 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T14:58:04.256 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:33:17.406 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T14:58:04.271 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:33:17.421 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T14:58:15.250 INFO:teuthology.orchestra.run.smithi135.stderr:testUnorderedList (test.functional.tests.TestContainer) ... ok 2019-11-25T15:03:14.857 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:38:28.007 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:03:14.868 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:38:28.018 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:03:14.878 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:38:28.028 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:03:14.881 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:38:28.132 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:03:14.882 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:38:28.032 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:03:14.889 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:38:28.141 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:03:15.037 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:38:28.187 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:03:15.073 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:38:28.324 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:03:15.104 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:38:28.254 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:03:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerListing (test.functional.tests.TestContainerPaths) ... ok 2019-11-25T15:03:54.849 INFO:teuthology.orchestra.run.smithi135.stderr:testStructure (test.functional.tests.TestContainerPaths) ... ok 2019-11-25T15:04:15.384 INFO:teuthology.orchestra.run.smithi135.stderr:testTraverseContainer (test.functional.tests.TestContainerPaths) ... ok 2019-11-25T15:06:06.268 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:10.454 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:11.324 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:14.890 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:15.810 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerInfo (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:16.224 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:26.797 INFO:teuthology.orchestra.run.smithi135.stderr:testContainerNameLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:33.634 INFO:teuthology.orchestra.run.smithi135.stderr:testCreate (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:48.612 INFO:teuthology.orchestra.run.smithi135.stderr:testDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:48.903 INFO:teuthology.orchestra.run.smithi135.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:56.716 INFO:teuthology.orchestra.run.smithi135.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:06:57.155 INFO:teuthology.orchestra.run.smithi135.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:08:27.770 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:43:40.920 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:27.776 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:43:40.926 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:27.801 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:43:41.053 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:27.819 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:43:41.071 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:27.880 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:43:41.030 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:27.889 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:43:41.039 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:27.997 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:43:41.147 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:28.079 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:43:41.331 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:28.095 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:43:41.245 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:35.787 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:43:48.937 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:35.799 INFO:teuthology.orchestra.run.smithi135.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:08:35.809 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:43:49.061 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:35.811 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:43:48.961 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:35.814 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:43:49.066 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:35.838 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:43:48.988 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:35.850 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:43:49.102 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:35.856 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:43:49.005 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:35.873 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:43:49.023 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:35.891 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:43:49.040 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:08:38.481 INFO:teuthology.orchestra.run.smithi135.stderr:testFileOrder (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:08:56.172 INFO:teuthology.orchestra.run.smithi135.stderr:testFileThenContainerDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:09:03.299 INFO:teuthology.orchestra.run.smithi135.stderr:testLastFileMarker (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:09:55.214 INFO:teuthology.orchestra.run.smithi135.stderr:testMarkerLimitFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:11:10.879 INFO:teuthology.orchestra.run.smithi135.stderr:testPrefixAndLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:11:11.156 INFO:teuthology.orchestra.run.smithi135.stderr:testTooLongName (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:11:56.606 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:47:09.755 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:11:56.610 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:47:09.760 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:11:56.649 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:47:09.900 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:11:56.661 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:47:09.811 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:11:56.663 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:47:09.813 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:11:56.699 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:47:09.951 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:11:56.782 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:47:09.932 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:11:56.829 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:47:10.081 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:11:56.846 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:47:09.996 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:12:28.859 INFO:teuthology.orchestra.run.smithi135.stderr:testUnorderedList (test.functional.tests.TestContainerUTF8) ... ok 2019-11-25T15:13:40.034 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:48:53.183 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:13:40.049 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:48:53.199 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:13:40.063 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:48:53.213 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:13:40.069 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:48:53.218 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:13:40.075 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:48:53.326 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:13:40.095 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:48:53.346 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:13:40.134 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:48:53.284 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:13:40.168 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:48:53.318 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:13:40.211 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:48:53.463 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:16:57.611 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:52:10.761 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:16:57.631 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:52:10.781 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:16:57.633 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:52:10.782 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:16:57.648 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:52:10.797 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:16:57.648 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:52:10.900 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:16:57.677 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:52:10.929 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:16:57.722 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:52:10.871 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:16:57.762 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:52:10.911 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:16:57.766 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:52:11.018 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:17:47.658 INFO:teuthology.orchestra.run.smithi135.stderr:test_get_manifest (test.functional.tests.TestDlo) ... ok 2019-11-25T15:17:48.204 INFO:teuthology.orchestra.run.smithi135.stderr:test_get_manifest_document_itself (test.functional.tests.TestDlo) ... ok 2019-11-25T15:17:56.423 INFO:teuthology.orchestra.run.smithi135.stderr:test_get_range (test.functional.tests.TestDlo) ... ok 2019-11-25T15:17:57.975 INFO:teuthology.orchestra.run.smithi135.stderr:test_get_range_out_of_range (test.functional.tests.TestDlo) ... ok 2019-11-25T15:18:52.300 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:54:05.449 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:18:52.308 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:54:05.456 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:18:52.319 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:54:05.468 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:18:52.323 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:54:05.472 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:18:52.331 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:54:05.583 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:18:52.345 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:54:05.597 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:18:52.389 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:54:05.539 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:18:52.403 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:54:05.553 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:18:52.474 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:54:05.725 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:19:11.383 INFO:teuthology.orchestra.run.smithi135.stderr:test_get_manifest (test.functional.tests.TestDloUTF8) ... ok 2019-11-25T15:19:12.050 INFO:teuthology.orchestra.run.smithi135.stderr:test_get_manifest_document_itself (test.functional.tests.TestDloUTF8) ... ok 2019-11-25T15:19:20.058 INFO:teuthology.orchestra.run.smithi135.stderr:test_get_range (test.functional.tests.TestDloUTF8) ... ok 2019-11-25T15:19:21.269 INFO:teuthology.orchestra.run.smithi135.stderr:test_get_range_out_of_range (test.functional.tests.TestDloUTF8) ... ok 2019-11-25T15:20:06.083 INFO:teuthology.orchestra.run.smithi135.stderr:testBadHeaders (test.functional.tests.TestFile) ... ok 2019-11-25T15:20:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:testBlankMetadataName (test.functional.tests.TestFile) ... ok 2019-11-25T15:24:04.071 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:59:17.220 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:24:04.077 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:59:17.226 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:24:04.095 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:59:17.244 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:24:04.101 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:59:17.250 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:24:04.112 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:59:17.364 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:24:04.157 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:59:17.408 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:24:04.284 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:05:59:17.432 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:24:04.289 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:05:59:17.438 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:24:04.374 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:05:59:17.626 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:25:19.276 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:00:32.425 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:25:19.316 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:00:32.465 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:25:19.332 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:00:32.481 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:25:19.335 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:00:32.484 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:25:19.360 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:00:32.612 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:25:19.372 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:00:32.624 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:25:19.379 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:00:32.528 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:25:19.382 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:00:32.532 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:25:19.451 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:00:32.702 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:28:40.789 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:28:40.769+0000 16949700 -1 osd.7 137 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:28:02.926293+0000 front 2019-11-25T15:28:00.256675+0000 (oldest deadline 2019-11-25T15:28:40.689859+0000) 2019-11-25T15:28:41.199 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:28:41.192+0000 16949700 -1 osd.3 137 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:28:00.702646+0000 front 2019-11-25T15:27:59.952297+0000 (oldest deadline 2019-11-25T15:28:40.545157+0000) 2019-11-25T15:28:41.764 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:28:41.760+0000 16949700 -1 osd.7 137 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:28:02.926293+0000 front 2019-11-25T15:28:00.256675+0000 (oldest deadline 2019-11-25T15:28:40.689859+0000) 2019-11-25T15:28:42.006 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:28:41.987+0000 16949700 -1 osd.4 137 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:28:01.749151+0000 front 2019-11-25T15:27:59.839826+0000 (oldest deadline 2019-11-25T15:28:41.403786+0000) 2019-11-25T15:28:42.208 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:28:42.206+0000 16949700 -1 osd.3 137 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:28:00.702646+0000 front 2019-11-25T15:27:59.952297+0000 (oldest deadline 2019-11-25T15:28:40.545157+0000) 2019-11-25T15:28:42.247 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:28:42.224+0000 16949700 -1 osd.6 137 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:28:01.798742+0000 front 2019-11-25T15:28:01.613865+0000 (oldest deadline 2019-11-25T15:28:41.701536+0000) 2019-11-25T15:28:42.725 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:28:42.722+0000 16949700 -1 osd.7 137 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:28:02.926293+0000 front 2019-11-25T15:28:00.256675+0000 (oldest deadline 2019-11-25T15:28:40.689859+0000) 2019-11-25T15:29:02.738 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:04:15.886 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:29:02.747 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:04:15.896 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:29:02.761 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:04:15.910 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:29:02.768 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:04:15.916 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:29:02.770 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:04:16.022 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:29:02.779 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:04:16.029 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:29:02.911 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:04:16.060 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:29:02.915 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:04:16.063 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:29:02.966 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:04:16.218 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:29:38.741 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:29:38.730+0000 16949700 -1 osd.0 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.081607+0000 front 2019-11-25T15:28:58.639491+0000 (oldest deadline 2019-11-25T15:29:38.217133+0000) 2019-11-25T15:29:38.772 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:29:38.767+0000 16949700 -1 osd.7 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.830934+0000 front 2019-11-25T15:28:58.632084+0000 (oldest deadline 2019-11-25T15:29:37.875789+0000) 2019-11-25T15:29:39.719 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:29:39.718+0000 16949700 -1 osd.0 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.081607+0000 front 2019-11-25T15:28:58.639491+0000 (oldest deadline 2019-11-25T15:29:38.217133+0000) 2019-11-25T15:29:39.772 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:29:39.768+0000 16949700 -1 osd.7 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.830934+0000 front 2019-11-25T15:28:58.632084+0000 (oldest deadline 2019-11-25T15:29:37.875789+0000) 2019-11-25T15:29:39.986 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:29:39.979+0000 16949700 -1 osd.3 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.998839+0000 front 2019-11-25T15:28:54.991752+0000 (oldest deadline 2019-11-25T15:29:39.627649+0000) 2019-11-25T15:29:40.224 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:29:40.215+0000 16949700 -1 osd.2 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:59.635957+0000 front 2019-11-25T15:28:59.641710+0000 (oldest deadline 2019-11-25T15:29:39.548453+0000) 2019-11-25T15:29:40.695 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:29:40.694+0000 16949700 -1 osd.0 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.081607+0000 front 2019-11-25T15:28:58.639491+0000 (oldest deadline 2019-11-25T15:29:38.217133+0000) 2019-11-25T15:29:40.814 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:29:40.806+0000 16949700 -1 osd.7 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.830934+0000 front 2019-11-25T15:28:58.632084+0000 (oldest deadline 2019-11-25T15:29:37.875789+0000) 2019-11-25T15:29:41.029 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:29:41.028+0000 16949700 -1 osd.3 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.998839+0000 front 2019-11-25T15:28:54.991752+0000 (oldest deadline 2019-11-25T15:29:39.627649+0000) 2019-11-25T15:29:41.262 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:29:41.260+0000 16949700 -1 osd.2 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:59.635957+0000 front 2019-11-25T15:28:59.641710+0000 (oldest deadline 2019-11-25T15:29:39.548453+0000) 2019-11-25T15:29:41.581 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:29:41.573+0000 16949700 -1 osd.5 144 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-25T15:29:41.898 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:29:41.728+0000 16949700 -1 osd.0 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.081607+0000 front 2019-11-25T15:28:58.639491+0000 (oldest deadline 2019-11-25T15:29:38.217133+0000) 2019-11-25T15:29:41.898 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:29:41.783+0000 16949700 -1 osd.7 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.830934+0000 front 2019-11-25T15:28:58.632084+0000 (oldest deadline 2019-11-25T15:29:37.875789+0000) 2019-11-25T15:29:42.057 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:29:42.048+0000 16949700 -1 osd.3 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:54.998839+0000 front 2019-11-25T15:28:54.991752+0000 (oldest deadline 2019-11-25T15:29:39.627649+0000) 2019-11-25T15:29:42.142 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:29:42.137+0000 16949700 -1 osd.6 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:56.286143+0000 front 2019-11-25T15:28:56.361409+0000 (oldest deadline 2019-11-25T15:29:41.343605+0000) 2019-11-25T15:29:42.246 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:29:42.234+0000 16949700 -1 osd.2 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:59.635957+0000 front 2019-11-25T15:28:59.641710+0000 (oldest deadline 2019-11-25T15:29:39.548453+0000) 2019-11-25T15:29:42.769 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:29:42.637+0000 16949700 -1 osd.5 145 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e142) 2019-11-25T15:29:42.783 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:29:42.778+0000 16949700 -1 osd.1 144 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:28:56.977157+0000 front 2019-11-25T15:28:56.896960+0000 (oldest deadline 2019-11-25T15:29:41.997253+0000) 2019-11-25T15:31:02.022 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:31:01.926+0000 33a6d700 -1 osd.2 148 build_incremental_map_msg missing incremental map 148 2019-11-25T15:31:02.045 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:31:02.029+0000 3426e700 -1 osd.5 148 build_incremental_map_msg missing incremental map 148 2019-11-25T15:31:02.155 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:31:02.107+0000 37a75700 -1 osd.5 148 build_incremental_map_msg missing incremental map 148 2019-11-25T15:31:02.220 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:31:02.117+0000 37a75700 -1 osd.5 148 build_incremental_map_msg missing incremental map 148 2019-11-25T15:31:02.266 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:31:02.188+0000 3a27a700 -1 osd.2 148 build_incremental_map_msg missing incremental map 148 2019-11-25T15:31:02.283 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:31:02.154+0000 34a6f700 -1 osd.5 148 build_incremental_map_msg missing incremental map 148 2019-11-25T15:31:02.371 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:31:02.219+0000 37a75700 -1 osd.5 148 build_incremental_map_msg missing incremental map 148 2019-11-25T15:31:02.373 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:31:02.223+0000 35a71700 -1 osd.5 148 build_incremental_map_msg missing incremental map 148 2019-11-25T15:31:32.614 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:32.611+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:33.587 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:33.586+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:34.573 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:34.572+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:35.551 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:35.550+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:36.565 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:36.564+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:37.608 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:37.607+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:38.604 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:38.603+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:39.640 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:39.639+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:40.643 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:40.642+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:41.702 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:41.693+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:42.687 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:42.685+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:43.657 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:43.655+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:44.626 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:44.626+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:45.626 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:45.625+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:46.618 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:46.617+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:47.637 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:47.633+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:48.617 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:48.616+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:49.668 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:49.666+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:50.670 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:50.669+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:51.676 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:51.675+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:52.678 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:52.677+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:53.673 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:53.671+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:54.679 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:54.678+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:55.720 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:55.718+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:56.752 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:56.749+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:57.803 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:57.801+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:58.789 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:58.787+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:31:59.761 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:31:59.759+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:00.757 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:00.756+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:01.760 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:01.759+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:02.746 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:02.745+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:03.649 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:32:03.645+0000 16949700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.860437+0000 front 2019-11-25T15:31:19.128174+0000 (oldest deadline 2019-11-25T15:32:02.807614+0000) 2019-11-25T15:32:03.674 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:32:03.671+0000 16949700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:21.054605+0000 front 2019-11-25T15:31:23.898180+0000 (oldest deadline 2019-11-25T15:32:03.304536+0000) 2019-11-25T15:32:03.772 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:03.772+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:04.298 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:32:04.296+0000 16949700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.920375+0000 front 2019-11-25T15:31:21.050012+0000 (oldest deadline 2019-11-25T15:32:03.821221+0000) 2019-11-25T15:32:04.642 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:32:04.637+0000 16949700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.860437+0000 front 2019-11-25T15:31:19.128174+0000 (oldest deadline 2019-11-25T15:32:02.807614+0000) 2019-11-25T15:32:04.712 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:32:04.708+0000 16949700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:21.054605+0000 front 2019-11-25T15:31:23.898180+0000 (oldest deadline 2019-11-25T15:32:03.304536+0000) 2019-11-25T15:32:04.782 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:04.781+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:05.258 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:32:05.255+0000 16949700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:20.466463+0000 front 2019-11-25T15:31:20.467402+0000 (oldest deadline 2019-11-25T15:32:04.668645+0000) 2019-11-25T15:32:05.298 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:32:05.297+0000 16949700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.920375+0000 front 2019-11-25T15:31:21.050012+0000 (oldest deadline 2019-11-25T15:32:03.821221+0000) 2019-11-25T15:32:05.550 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:32:05.547+0000 16949700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.770845+0000 front 2019-11-25T15:31:23.790262+0000 (oldest deadline 2019-11-25T15:32:05.055712+0000) 2019-11-25T15:32:05.649 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:32:05.645+0000 16949700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.860437+0000 front 2019-11-25T15:31:19.128174+0000 (oldest deadline 2019-11-25T15:32:02.807614+0000) 2019-11-25T15:32:05.712 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:32:05.709+0000 16949700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:21.054605+0000 front 2019-11-25T15:31:23.898180+0000 (oldest deadline 2019-11-25T15:32:03.304536+0000) 2019-11-25T15:32:05.768 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:05.767+0000 16949700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:20.732002+0000 front 2019-11-25T15:31:21.543061+0000 (oldest deadline 2019-11-25T15:32:05.194087+0000) 2019-11-25T15:32:05.769 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:05.768+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:06.255 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:32:06.253+0000 16949700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.920375+0000 front 2019-11-25T15:31:21.050012+0000 (oldest deadline 2019-11-25T15:32:03.821221+0000) 2019-11-25T15:32:06.301 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:32:06.299+0000 16949700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:20.466463+0000 front 2019-11-25T15:31:20.467402+0000 (oldest deadline 2019-11-25T15:32:04.668645+0000) 2019-11-25T15:32:06.567 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:32:06.563+0000 16949700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.770845+0000 front 2019-11-25T15:31:23.790262+0000 (oldest deadline 2019-11-25T15:32:05.055712+0000) 2019-11-25T15:32:06.616 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:32:06.611+0000 16949700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.860437+0000 front 2019-11-25T15:31:19.128174+0000 (oldest deadline 2019-11-25T15:32:02.807614+0000) 2019-11-25T15:32:06.673 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:32:06.669+0000 16949700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:21.054605+0000 front 2019-11-25T15:31:23.898180+0000 (oldest deadline 2019-11-25T15:32:03.304536+0000) 2019-11-25T15:32:06.801 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:06.797+0000 16949700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:20.732002+0000 front 2019-11-25T15:31:21.543061+0000 (oldest deadline 2019-11-25T15:32:05.194087+0000) 2019-11-25T15:32:06.803 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:06.799+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:07.012 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:32:07.009+0000 16949700 -1 osd.0 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:21.610378+0000 front 2019-11-25T15:31:21.609989+0000 (oldest deadline 2019-11-25T15:32:06.320582+0000) 2019-11-25T15:32:07.223 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:32:07.222+0000 16949700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.920375+0000 front 2019-11-25T15:31:21.050012+0000 (oldest deadline 2019-11-25T15:32:03.821221+0000) 2019-11-25T15:32:07.278 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:32:07.277+0000 16949700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:20.466463+0000 front 2019-11-25T15:31:20.467402+0000 (oldest deadline 2019-11-25T15:32:04.668645+0000) 2019-11-25T15:32:07.569 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:32:07.566+0000 16949700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.770845+0000 front 2019-11-25T15:31:23.790262+0000 (oldest deadline 2019-11-25T15:32:05.055712+0000) 2019-11-25T15:32:07.655 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:32:07.652+0000 16949700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.860437+0000 front 2019-11-25T15:31:19.128174+0000 (oldest deadline 2019-11-25T15:32:02.807614+0000) 2019-11-25T15:32:07.696 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:32:07.693+0000 16949700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:21.054605+0000 front 2019-11-25T15:31:23.898180+0000 (oldest deadline 2019-11-25T15:32:03.304536+0000) 2019-11-25T15:32:07.783 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:07.782+0000 16949700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:20.732002+0000 front 2019-11-25T15:31:21.543061+0000 (oldest deadline 2019-11-25T15:32:05.194087+0000) 2019-11-25T15:32:07.784 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:07.783+0000 16949700 -1 osd.3 149 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:08.255 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:32:08.254+0000 16949700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:23.920375+0000 front 2019-11-25T15:31:21.050012+0000 (oldest deadline 2019-11-25T15:32:03.821221+0000) 2019-11-25T15:32:08.259 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:32:08.257+0000 16949700 -1 osd.2 149 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:31:20.466463+0000 front 2019-11-25T15:31:20.467402+0000 (oldest deadline 2019-11-25T15:32:04.668645+0000) 2019-11-25T15:32:09.268 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:09.110+0000 16949700 -1 osd.3 150 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:10.153 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:10.152+0000 16949700 -1 osd.3 151 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:11.393 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:11.377+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:12.376 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:12.375+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:13.351 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:13.350+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:14.367 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:14.366+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:15.373 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:15.373+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:16.379 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:16.378+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:17.379 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:17.378+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:18.359 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:18.358+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:19.405 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:19.405+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:20.389 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:20.388+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:21.404 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:21.404+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:22.418 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:22.418+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:23.396 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:23.395+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:24.428 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:24.427+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:25.463 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:25.462+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:26.436 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:26.435+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:27.477 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:27.476+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:28.438 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:28.437+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:29.452 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:29.451+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:30.434 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:30.432+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:31.448 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:31.444+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:32.447 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:32.445+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:33.452 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:33.451+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:34.412 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:34.411+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:35.465 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:35.464+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:36.468 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:36.467+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:37.432 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:37.431+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:38.432 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:32:38.431+0000 16949700 -1 osd.3 152 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:108529 2.0s0 2:0177ce8c:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_5f481938ce9148a792b3621e2511e355:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10053 in=10053b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (55) in=75b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e148) 2019-11-25T15:32:53.616 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:08:06.765 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:32:53.622 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:08:06.771 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:32:53.635 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:08:06.784 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:32:53.638 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:08:06.787 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:32:53.640 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:08:06.892 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:32:53.649 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:08:06.900 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:32:53.893 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:08:07.042 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:32:53.913 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:08:07.165 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:32:53.950 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:08:07.098 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:32:55.018 INFO:teuthology.orchestra.run.smithi135.stderr:testChunkedPut (test.functional.tests.TestFile) ... ok 2019-11-25T15:33:05.651 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:33:05.650+0000 16949700 -1 osd.3 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:23.334140+0000 front 2019-11-25T15:32:22.506936+0000 (oldest deadline 2019-11-25T15:33:05.190176+0000) 2019-11-25T15:33:05.797 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:05.795+0000 16949700 -1 osd.2 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:05.823 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:33:05.818+0000 16949700 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:25.106708+0000 front 2019-11-25T15:32:24.583944+0000 (oldest deadline 2019-11-25T15:33:05.069458+0000) 2019-11-25T15:33:06.626 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:33:06.625+0000 16949700 -1 osd.3 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:23.334140+0000 front 2019-11-25T15:32:22.506936+0000 (oldest deadline 2019-11-25T15:33:05.190176+0000) 2019-11-25T15:33:06.771 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:06.769+0000 16949700 -1 osd.2 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:06.780 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:33:06.776+0000 16949700 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:25.106708+0000 front 2019-11-25T15:32:24.583944+0000 (oldest deadline 2019-11-25T15:33:05.069458+0000) 2019-11-25T15:33:06.942 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:33:06.940+0000 16949700 -1 osd.0 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:22.855087+0000 front 2019-11-25T15:32:22.856501+0000 (oldest deadline 2019-11-25T15:33:06.497103+0000) 2019-11-25T15:33:07.644 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:33:07.641+0000 16949700 -1 osd.3 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:23.334140+0000 front 2019-11-25T15:32:22.506936+0000 (oldest deadline 2019-11-25T15:33:05.190176+0000) 2019-11-25T15:33:07.747 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:07.745+0000 16949700 -1 osd.2 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:07.767 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:33:07.763+0000 16949700 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:25.106708+0000 front 2019-11-25T15:32:24.583944+0000 (oldest deadline 2019-11-25T15:33:05.069458+0000) 2019-11-25T15:33:07.961 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:33:07.959+0000 16949700 -1 osd.0 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:22.855087+0000 front 2019-11-25T15:32:22.856501+0000 (oldest deadline 2019-11-25T15:33:06.497103+0000) 2019-11-25T15:33:08.662 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:33:08.661+0000 16949700 -1 osd.3 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:23.334140+0000 front 2019-11-25T15:32:22.506936+0000 (oldest deadline 2019-11-25T15:33:05.190176+0000) 2019-11-25T15:33:08.755 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:08.754+0000 16949700 -1 osd.2 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:08.803 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:33:08.799+0000 16949700 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:25.106708+0000 front 2019-11-25T15:32:24.583944+0000 (oldest deadline 2019-11-25T15:33:05.069458+0000) 2019-11-25T15:33:08.935 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:33:08.928+0000 16949700 -1 osd.0 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:22.855087+0000 front 2019-11-25T15:32:22.856501+0000 (oldest deadline 2019-11-25T15:33:06.497103+0000) 2019-11-25T15:33:09.665 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:33:09.664+0000 16949700 -1 osd.3 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:23.334140+0000 front 2019-11-25T15:32:22.506936+0000 (oldest deadline 2019-11-25T15:33:05.190176+0000) 2019-11-25T15:33:09.758 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:09.757+0000 16949700 -1 osd.2 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:09.773 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:33:09.771+0000 16949700 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:25.106708+0000 front 2019-11-25T15:32:24.583944+0000 (oldest deadline 2019-11-25T15:33:05.069458+0000) 2019-11-25T15:33:09.925 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:33:09.923+0000 16949700 -1 osd.0 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:22.855087+0000 front 2019-11-25T15:32:22.856501+0000 (oldest deadline 2019-11-25T15:33:06.497103+0000) 2019-11-25T15:33:10.300 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:33:10.266+0000 16949700 -1 osd.7 153 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.505400+0000 front 2019-11-25T15:32:23.682511+0000 (oldest deadline 2019-11-25T15:33:09.244871+0000) 2019-11-25T15:33:10.736 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:33:10.733+0000 16949700 -1 osd.6 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:25.106708+0000 front 2019-11-25T15:32:24.583944+0000 (oldest deadline 2019-11-25T15:33:05.069458+0000) 2019-11-25T15:33:10.797 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:10.796+0000 16949700 -1 osd.2 152 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:10.894 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:33:10.796+0000 16949700 -1 osd.3 153 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:23.334140+0000 front 2019-11-25T15:32:22.506936+0000 (oldest deadline 2019-11-25T15:33:05.190176+0000) 2019-11-25T15:33:10.962 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:33:10.961+0000 16949700 -1 osd.0 153 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:22.855087+0000 front 2019-11-25T15:32:22.856501+0000 (oldest deadline 2019-11-25T15:33:06.497103+0000) 2019-11-25T15:33:11.324 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:33:11.321+0000 16949700 -1 osd.7 153 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.505400+0000 front 2019-11-25T15:32:23.682511+0000 (oldest deadline 2019-11-25T15:33:09.244871+0000) 2019-11-25T15:33:11.776 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:33:11.774+0000 16949700 -1 osd.6 153 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:25.106708+0000 front 2019-11-25T15:32:24.583944+0000 (oldest deadline 2019-11-25T15:33:05.069458+0000) 2019-11-25T15:33:11.814 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:11.813+0000 16949700 -1 osd.2 153 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:11.826 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:33:11.825+0000 16949700 -1 osd.3 153 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:23.334140+0000 front 2019-11-25T15:32:22.506936+0000 (oldest deadline 2019-11-25T15:33:05.190176+0000) 2019-11-25T15:33:11.953 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:33:11.952+0000 16949700 -1 osd.0 153 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:22.855087+0000 front 2019-11-25T15:32:22.856501+0000 (oldest deadline 2019-11-25T15:33:06.497103+0000) 2019-11-25T15:33:12.369 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:33:12.364+0000 16949700 -1 osd.7 153 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.505400+0000 front 2019-11-25T15:32:23.682511+0000 (oldest deadline 2019-11-25T15:33:09.244871+0000) 2019-11-25T15:33:12.929 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:12.896+0000 16949700 -1 osd.2 154 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:13.046 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:33:12.999+0000 16949700 -1 osd.6 154 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:25.106708+0000 front 2019-11-25T15:32:24.583944+0000 (oldest deadline 2019-11-25T15:33:05.069458+0000) 2019-11-25T15:33:13.152 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:33:13.055+0000 16949700 -1 osd.3 154 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:23.334140+0000 front 2019-11-25T15:32:22.506936+0000 (oldest deadline 2019-11-25T15:33:05.190176+0000) 2019-11-25T15:33:13.437 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:33:13.337+0000 16949700 -1 osd.0 154 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:22.855087+0000 front 2019-11-25T15:32:22.856501+0000 (oldest deadline 2019-11-25T15:33:06.497103+0000) 2019-11-25T15:33:13.469 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:33:13.450+0000 16949700 -1 osd.7 154 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.505400+0000 front 2019-11-25T15:32:23.682511+0000 (oldest deadline 2019-11-25T15:33:09.244871+0000) 2019-11-25T15:33:13.906 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:13.896+0000 16949700 -1 osd.2 155 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:14.053 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:33:14.051+0000 16949700 -1 osd.6 155 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:25.106708+0000 front 2019-11-25T15:32:24.583944+0000 (oldest deadline 2019-11-25T15:33:05.069458+0000) 2019-11-25T15:33:14.230 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:33:14.229+0000 16949700 -1 osd.3 155 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:23.334140+0000 front 2019-11-25T15:32:22.506936+0000 (oldest deadline 2019-11-25T15:33:05.190176+0000) 2019-11-25T15:33:14.314 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:33:14.301+0000 38276700 -1 osd.5 155 build_incremental_map_msg missing incremental map 155 2019-11-25T15:33:14.495 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:33:14.492+0000 16949700 -1 osd.7 155 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.505400+0000 front 2019-11-25T15:32:23.682511+0000 (oldest deadline 2019-11-25T15:33:09.244871+0000) 2019-11-25T15:33:14.535 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:33:14.510+0000 16949700 -1 osd.0 155 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:22.855087+0000 front 2019-11-25T15:32:22.856501+0000 (oldest deadline 2019-11-25T15:33:06.497103+0000) 2019-11-25T15:33:14.640 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:33:14.547+0000 34a6f700 -1 osd.5 155 build_incremental_map_msg missing incremental map 155 2019-11-25T15:33:14.662 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:33:14.563+0000 3b27c700 -1 osd.5 155 build_incremental_map_msg missing incremental map 155 2019-11-25T15:33:14.680 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:33:14.571+0000 3b27c700 -1 osd.5 155 build_incremental_map_msg missing incremental map 155 2019-11-25T15:33:14.869 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:33:14.635+0000 3426e700 -1 osd.5 155 build_incremental_map_msg missing incremental map 155 2019-11-25T15:33:14.899 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:33:14.657+0000 39a79700 -1 osd.5 155 build_incremental_map_msg missing incremental map 155 2019-11-25T15:33:14.974 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:14.923+0000 16949700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:15.015 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:33:14.864+0000 36272700 -1 osd.5 155 build_incremental_map_msg missing incremental map 155 2019-11-25T15:33:15.066 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:33:14.953+0000 38276700 -1 osd.5 155 build_incremental_map_msg missing incremental map 155 2019-11-25T15:33:15.140 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:33:15.114+0000 16949700 -1 osd.6 156 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:25.106708+0000 front 2019-11-25T15:32:24.583944+0000 (oldest deadline 2019-11-25T15:33:05.069458+0000) 2019-11-25T15:33:15.239 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:33:15.237+0000 16949700 -1 osd.3 156 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:23.334140+0000 front 2019-11-25T15:32:22.506936+0000 (oldest deadline 2019-11-25T15:33:05.190176+0000) 2019-11-25T15:33:15.526 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:33:15.525+0000 16949700 -1 osd.0 156 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:22.855087+0000 front 2019-11-25T15:32:22.856501+0000 (oldest deadline 2019-11-25T15:33:06.497103+0000) 2019-11-25T15:33:15.532 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:33:15.530+0000 16949700 -1 osd.7 156 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.505400+0000 front 2019-11-25T15:32:23.682511+0000 (oldest deadline 2019-11-25T15:33:09.244871+0000) 2019-11-25T15:33:15.905 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:33:15.898+0000 16949700 -1 osd.2 156 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:32:24.011959+0000 front 2019-11-25T15:32:24.500095+0000 (oldest deadline 2019-11-25T15:33:05.674104+0000) 2019-11-25T15:33:41.015 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:08:54.164 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:33:41.045 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:08:54.194 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:33:41.059 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:08:54.207 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:33:41.060 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:08:54.209 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:33:41.087 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:08:54.338 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:33:41.096 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:08:54.347 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:33:41.120 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:08:54.267 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:33:41.160 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:08:54.302 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:33:41.190 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:08:54.442 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:34:22.833 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:34:22.822+0000 33a6d700 -1 osd.4 163 build_incremental_map_msg missing incremental map 163 2019-11-25T15:34:23.352 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:34:23.182+0000 33a6d700 -1 osd.4 163 build_incremental_map_msg missing incremental map 163 2019-11-25T15:34:37.366 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:34:37.213+0000 33a6d700 -1 osd.5 163 build_incremental_map_msg missing incremental map 148 2019-11-25T15:34:37.513 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:34:37.494+0000 33a6d700 -1 osd.5 163 build_incremental_map_msg missing incremental map 155 2019-11-25T15:34:52.077 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:34:52.071+0000 16949700 -1 osd.4 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109065 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821484416 gen 67] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-25T15:34:53.062 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:34:53.060+0000 16949700 -1 osd.4 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109065 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821484416 gen 67] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-25T15:34:54.100 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:34:54.092+0000 16949700 -1 osd.4 163 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:109065 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821484416 gen 67] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-11-25T15:35:30.923 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:30.918+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:31.250 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:31.248+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:31.861 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:31.858+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:31.906 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:31.901+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:32.258 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:32.251+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:32.380 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:32.378+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:32.871 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:32.868+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:32.876 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:32.872+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:33.235 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:33.234+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:33.394 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:33.392+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:33.652 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:33.648+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:33.835 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:33.832+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:33.881 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:33.877+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:34.200 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:34.197+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:34.416 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:34.413+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:34.627 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:34.623+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:34.802 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:34.800+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:34.924 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:34.920+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:35.185 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:35.182+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:35.347 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:35.341+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:35.407 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:35.406+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:35.587 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:35.583+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:35.802 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:35.777+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:35.934 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:35.929+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:36.222 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:36.219+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:36.321 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:36.317+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:36.407 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:36.405+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:36.606 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:36.603+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:36.815 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:36.813+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:36.946 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:36.942+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:37.261 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:37.259+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:37.295 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:37.291+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:37.415 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:37.413+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:37.611 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:37.608+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:37.833 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:37.831+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:37.965 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:37.960+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:38.306 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:38.304+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:38.326 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:38.322+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:38.423 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:38.422+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:38.644 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:38.640+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:38.878 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:38.875+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:38.972 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:38.965+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:39.296 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:39.294+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:39.347 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:39.343+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:39.441 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:39.436+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:39.685 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:39.678+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:39.873 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:39.869+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:39.959 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:39.955+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:40.254 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:40.251+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:40.321 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:40.316+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:40.478 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:40.475+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:40.720 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:40.717+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:40.869 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:40.865+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:40.951 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:40.945+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:41.259 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:41.256+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:41.363 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:41.359+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:41.511 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:41.508+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:41.749 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:10:54.897 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:35:41.758 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:41.754+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:41.801 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:10:54.949 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:35:41.852 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:10:55.104 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:35:41.856 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:10:55.005 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:35:41.860 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:10:55.110 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:35:41.863 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:10:55.011 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:35:41.908 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:41.904+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:41.909 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:41.907+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:41.999 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:10:55.147 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:35:42.029 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:10:55.280 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:35:42.093 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:10:55.241 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:35:42.219 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:42.215+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:42.320 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:42.317+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:42.563 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:42.558+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:42.714 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:42.711+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:42.885 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:42.880+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:42.953 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:42.950+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:43.264 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:43.261+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:43.360 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:43.355+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:43.595 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:43.591+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:43.757 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:43.754+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:43.929 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:43.924+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:43.961 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:43.958+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:44.074 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:35:44.072+0000 16949700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.446052+0000 front 2019-11-25T15:34:46.462636+0000 (oldest deadline 2019-11-25T15:35:43.234050+0000) 2019-11-25T15:35:44.253 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:44.251+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:44.348 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:44.344+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:44.571 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:44.568+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:44.798 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:44.791+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:44.903 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:44.900+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:44.997 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:44.994+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:45.052 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:35:45.050+0000 16949700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.446052+0000 front 2019-11-25T15:34:46.462636+0000 (oldest deadline 2019-11-25T15:35:43.234050+0000) 2019-11-25T15:35:45.249 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:45.246+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:45.395 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:45.393+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:45.574 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:45.572+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:45.787 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:45.783+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:45.933 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:45.927+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:45.993 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:45.986+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:35:46.076 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:35:46.073+0000 16949700 -1 osd.2 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.446052+0000 front 2019-11-25T15:34:46.462636+0000 (oldest deadline 2019-11-25T15:35:43.234050+0000) 2019-11-25T15:35:46.232 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:35:46.229+0000 16949700 -1 osd.1 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.191363+0000 front 2019-11-25T15:34:46.217599+0000 (oldest deadline 2019-11-25T15:35:30.809481+0000) 2019-11-25T15:35:46.443 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:35:46.439+0000 16949700 -1 osd.7 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:50.087890+0000 front 2019-11-25T15:34:50.071783+0000 (oldest deadline 2019-11-25T15:35:35.265537+0000) 2019-11-25T15:35:46.551 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:35:46.549+0000 16949700 -1 osd.3 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:46.528984+0000 front 2019-11-25T15:34:46.550842+0000 (oldest deadline 2019-11-25T15:35:31.533357+0000) 2019-11-25T15:35:46.763 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:35:46.757+0000 16949700 -1 osd.6 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.021583+0000 front 2019-11-25T15:34:48.574476+0000 (oldest deadline 2019-11-25T15:35:33.277167+0000) 2019-11-25T15:35:46.938 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:35:46.934+0000 16949700 -1 osd.4 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:47.838165+0000 front 2019-11-25T15:34:47.234012+0000 (oldest deadline 2019-11-25T15:35:30.702817+0000) 2019-11-25T15:35:46.950 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:35:46.948+0000 16949700 -1 osd.0 163 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:34:48.022330+0000 front 2019-11-25T15:34:48.328844+0000 (oldest deadline 2019-11-25T15:35:31.484829+0000) 2019-11-25T15:36:20.655 INFO:teuthology.orchestra.run.smithi135.stderr:testContentTypeGuessing (test.functional.tests.TestFile) ... ok 2019-11-25T15:36:41.565 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:11:54.713 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:36:41.574 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:11:54.720 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:36:41.586 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:11:54.838 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:36:41.596 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:11:54.843 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:36:41.596 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:11:54.745 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:36:41.603 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:11:54.750 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:36:41.698 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:11:54.950 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:36:41.731 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:11:54.879 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:36:41.737 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:11:54.885 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:36:42.436 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:36:42.416+0000 3426e700 -1 osd.5 168 build_incremental_map_msg missing incremental map 168 2019-11-25T15:36:42.668 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:36:42.652+0000 38276700 -1 osd.5 168 build_incremental_map_msg missing incremental map 168 2019-11-25T15:36:42.813 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:36:42.697+0000 38a77700 -1 osd.5 168 build_incremental_map_msg missing incremental map 168 2019-11-25T15:36:42.838 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:36:42.758+0000 34a6f700 -1 osd.5 168 build_incremental_map_msg missing incremental map 168 2019-11-25T15:36:42.846 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:36:42.763+0000 34a6f700 -1 osd.5 168 build_incremental_map_msg missing incremental map 168 2019-11-25T15:36:44.874 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:44.872+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:45.361 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:45.360+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:45.777 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:45.776+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:45.900 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:45.898+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:45.977 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:45.974+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:46.330 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:46.328+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:46.352 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:46.346+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:46.765 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:46.763+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:46.886 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:46.883+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:46.981 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:46.977+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:47.374 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:47.372+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:47.386 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:47.383+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:47.569 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:47.567+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:47.801 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:47.798+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:47.858 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:47.856+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:47.960 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:47.953+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:48.347 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:48.344+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:48.392 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:48.389+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:48.573 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:48.570+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:48.853 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:48.851+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:48.885 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:48.883+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:48.915 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:48.912+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:49.375 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:49.372+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:49.389 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:49.387+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:49.617 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:49.614+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:49.869 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:49.866+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:49.920 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:49.913+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:49.927 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:49.926+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:50.379 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:50.376+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:50.419 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:50.415+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:50.592 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:50.590+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:50.889 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:50.888+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:50.892 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:50.889+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:50.948 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:50.944+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:51.419 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:51.417+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:51.422 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:51.418+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:51.621 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:51.618+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:51.857 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:51.854+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:51.927 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:51.925+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:51.986 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:51.983+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:52.387 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:52.385+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:52.440 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:52.437+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:52.615 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:52.610+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:52.833 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:52.832+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:52.902 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:52.901+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:52.966 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:52.963+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:53.347 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:53.346+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:53.460 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:53.455+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:53.656 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:53.653+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:53.833 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:53.830+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:53.935 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:53.933+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:54.012 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:54.008+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:54.370 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:54.368+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:54.419 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:54.414+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:54.682 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:54.680+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:54.856 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:54.853+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:54.912 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:54.910+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:55.060 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:55.056+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:55.364 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:55.363+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:55.431 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:55.428+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:55.711 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:55.709+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:55.892 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:55.890+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:55.893 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:55.891+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:56.049 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:56.044+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:56.397 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:56.395+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:56.468 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:56.455+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:56.689 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:56.686+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:56.855 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:56.853+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:56.899 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:56.897+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:57.040 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:57.036+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:57.431 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:57.424+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:57.516 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:57.512+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:57.685 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:57.681+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:57.848 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:57.846+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:57.889 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:57.887+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:58.054 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:58.051+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:58.406 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:58.404+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:58.475 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:58.472+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:58.642 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:58.640+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:58.841 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:58.839+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:58.902 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:58.901+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:36:59.045 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:36:59.041+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:36:59.411 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:36:59.408+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:36:59.518 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:36:59.515+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:36:59.688 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:36:59.686+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:36:59.821 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:36:59.819+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:36:59.868 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:36:59.866+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:37:00.011 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:37:00.009+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:37:00.402 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:37:00.400+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:37:00.473 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:37:00.470+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:37:00.659 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:37:00.656+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:37:00.804 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:37:00.802+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:37:00.884 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:37:00.883+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:37:01.048 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:37:01.044+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:37:01.447 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:37:01.446+0000 16949700 -1 osd.0 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.668347+0000 front 2019-11-25T15:35:59.665243+0000 (oldest deadline 2019-11-25T15:36:44.337342+0000) 2019-11-25T15:37:01.475 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:37:01.473+0000 16949700 -1 osd.7 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.634589+0000 front 2019-11-25T15:36:03.629389+0000 (oldest deadline 2019-11-25T15:36:45.373853+0000) 2019-11-25T15:37:01.707 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:37:01.704+0000 16949700 -1 osd.2 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.779471+0000 front 2019-11-25T15:36:02.807515+0000 (oldest deadline 2019-11-25T15:36:47.229579+0000) 2019-11-25T15:37:01.761 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:37:01.758+0000 16949700 -1 osd.3 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:35:59.413661+0000 front 2019-11-25T15:35:59.566895+0000 (oldest deadline 2019-11-25T15:36:44.689118+0000) 2019-11-25T15:37:01.908 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:37:01.905+0000 16949700 -1 osd.1 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:02.528634+0000 front 2019-11-25T15:36:02.342060+0000 (oldest deadline 2019-11-25T15:36:45.749682+0000) 2019-11-25T15:37:02.045 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:37:02.042+0000 16949700 -1 osd.6 169 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:36:03.898884+0000 front 2019-11-25T15:36:03.643796+0000 (oldest deadline 2019-11-25T15:36:45.604430+0000) 2019-11-25T15:37:02.926 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:37:02.783+0000 38276700 -1 osd.5 170 build_incremental_map_msg missing incremental map 168 2019-11-25T15:38:12.615 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:38:12.610+0000 33a6d700 -1 osd.4 174 build_incremental_map_msg missing incremental map 174 2019-11-25T15:38:48.302 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:48.297+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:49.341 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:49.339+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:50.313 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:50.312+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:51.294 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:51.293+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:52.250 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:52.248+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:53.299 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:53.298+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:54.337 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:54.335+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:55.321 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:55.319+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:56.361 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:56.359+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:57.370 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:57.368+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:58.366 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:58.357+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:38:59.354 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:38:59.352+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:00.335 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:00.333+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:01.290 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:01.289+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:02.292 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:02.291+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:03.262 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:03.261+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:04.288 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:04.287+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:05.341 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:05.340+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:06.330 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:06.329+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:07.340 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:07.339+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:08.361 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:08.359+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:09.354 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:09.353+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:10.353 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:10.352+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:10.555 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:10.551+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:11.179 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:11.176+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:11.295 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:11.292+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:11.339 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:11.336+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:11.385 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:11.384+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:11.580 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:11.578+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:12.144 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:12.141+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:12.257 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:12.253+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:12.346 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:12.342+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:12.352 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:12.349+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:12.352 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:12.351+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:12.617 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:12.615+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:12.932 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:12.929+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:13.130 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:13.127+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:13.226 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:13.223+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:13.339 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:13.336+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:13.339 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:13.338+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:13.394 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:13.392+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:13.661 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:13.659+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:13.942 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:13.939+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:14.180 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:14.178+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:14.258 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:14.254+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:14.350 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:14.347+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:14.363 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:14.360+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:14.364 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:14.362+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:14.700 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:14.698+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:14.903 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:14.900+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:14.991 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:14.988+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:15.180 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:15.178+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:15.276 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:15.272+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:15.374 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:15.371+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:15.418 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:15.412+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:15.419 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:15.417+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:15.676 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:15.673+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:15.889 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:15.887+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:16.007 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:16.004+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:16.219 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:16.216+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:16.271 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:16.267+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:16.397 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:16.394+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:16.441 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:16.439+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:16.442 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:16.440+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:16.684 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:16.682+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:16.938 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:16.934+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:17.009 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:17.008+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:17.247 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:17.245+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:17.288 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:17.285+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:17.393 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:17.391+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:17.396 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:17.394+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:17.397 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:17.395+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:17.677 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:17.675+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:17.900 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:17.897+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:18.029 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:18.027+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:18.248 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:18.246+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:18.294 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:18.289+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:18.405 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:18.403+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:18.430 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:18.428+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:18.433 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:18.432+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:18.656 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:18.653+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:18.893 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:18.890+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:18.995 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:18.992+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:19.222 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:19.220+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:19.256 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:19.254+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:19.376 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:19.374+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:19.396 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:19.393+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:19.396 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:19.395+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:19.677 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:19.675+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:19.869 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:19.867+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:20.037 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:20.034+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:20.204 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:20.201+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:20.219 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:20.217+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:20.366 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:20.363+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:20.427 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:20.425+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:20.429 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:20.428+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:20.657 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:20.654+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:20.882 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:20.880+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:21.066 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:21.063+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:21.221 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:21.218+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:21.253 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:21.249+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:21.386 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:21.380+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:21.426 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:21.424+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:21.427 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:21.425+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:21.644 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:21.642+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:21.855 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:21.853+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:22.029 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:22.024+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:22.199 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:22.196+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:22.268 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:22.265+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:22.354 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:22.347+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:22.425 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:22.421+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:22.431 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:22.426+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:22.627 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:22.625+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:22.873 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:22.868+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:23.091 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:23.081+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:23.184 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:23.180+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:23.221 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:23.219+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:23.315 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:23.312+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:23.455 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:23.453+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:23.455 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:23.454+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:23.614 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:23.613+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:23.872 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:23.869+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:24.098 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:24.096+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:24.152 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:24.148+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:24.181 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:24.179+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:24.307 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:24.303+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:24.481 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:24.479+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:24.483 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:24.481+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:24.593 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:24.590+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:24.927 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:24.923+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:25.128 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:25.124+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:25.175 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:25.171+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:25.179 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:25.177+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:25.344 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:25.340+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:25.481 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:25.477+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:25.482 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:25.479+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:25.568 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:25.564+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:25.927 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:25.923+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:26.103 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:26.100+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:26.156 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:26.152+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:26.157 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:26.154+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:26.364 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:26.361+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:26.467 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:26.464+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:26.470 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:26.468+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:26.574 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:26.570+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:26.962 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:26.957+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:27.127 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:27.124+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:27.127 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:27.123+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:27.205 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:27.201+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:27.413 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:27.409+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:27.500 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:27.496+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:27.500 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:27.497+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:27.555 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:27.552+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:27.984 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:27.979+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:28.102 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:28.098+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:28.109 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:28.106+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:28.222 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:28.219+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:28.447 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:28.443+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:28.500 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:28.496+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:28.500 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:28.498+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:28.569 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:28.566+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:28.941 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:28.938+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:29.099 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:29.094+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:29.156 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:29.154+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:29.202 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:29.199+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:29.486 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:29.482+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:29.544 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:29.530+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:29.545 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:29.532+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:29.605 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:29.601+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:29.990 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:29.986+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:30.085 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:30.080+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:30.176 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:30.174+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:30.183 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:30.180+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:30.484 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:30.480+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:30.516 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:30.513+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:30.517 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:30.515+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:30.592 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:30.590+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:30.959 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:30.956+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:31.124 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:31.120+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:31.180 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:31.178+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:31.206 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:31.203+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:31.495 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:31.491+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:31.511 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:31.510+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:31.513 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:31.512+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:31.589 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:31.587+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:31.981 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:31.976+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:32.095 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:32.092+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:32.163 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:32.161+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:32.173 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:32.172+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:32.491 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:32.487+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:32.499 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:32.497+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:32.506 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:32.503+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:32.640 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:32.638+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:32.997 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:32.993+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:33.057 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:33.053+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:33.169 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:33.166+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:33.173 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:33.172+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:33.450 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:33.447+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:33.460 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:33.458+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:33.460 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:33.459+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:33.638 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:33.636+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:33.993 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:33.990+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:34.078 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:34.074+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:34.135 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:34.134+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:34.188 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:34.185+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:34.470 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:34.466+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:34.486 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:34.484+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:34.488 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:34.487+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:34.597 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:34.594+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:34.977 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:34.973+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:35.062 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:35.057+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:35.120 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:35.117+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:35.167 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:35.165+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:35.454 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:35.452+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:35.457 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:35.456+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:35.519 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:35.516+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:35.599 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:35.596+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:35.955 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:35.951+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:36.073 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:36.069+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:36.077 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:36.075+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:36.146 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:36.143+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:36.431 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:36.425+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:36.433 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:36.428+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:36.565 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:36.562+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:36.596 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:36.594+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:36.942 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:39:36.939+0000 16949700 -1 osd.6 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.162763+0000 front 2019-11-25T15:38:28.282361+0000 (oldest deadline 2019-11-25T15:39:12.169354+0000) 2019-11-25T15:39:37.036 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:39:37.031+0000 16949700 -1 osd.4 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.743624+0000 front 2019-11-25T15:38:25.779131+0000 (oldest deadline 2019-11-25T15:39:10.869983+0000) 2019-11-25T15:39:37.101 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:39:37.099+0000 16949700 -1 osd.0 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:29.158823+0000 front 2019-11-25T15:38:29.151342+0000 (oldest deadline 2019-11-25T15:39:14.430334+0000) 2019-11-25T15:39:37.121 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:39:37.119+0000 16949700 -1 osd.3 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:28.958573+0000 front 2019-11-25T15:38:28.960212+0000 (oldest deadline 2019-11-25T15:39:10.940983+0000) 2019-11-25T15:39:37.445 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:37.443+0000 16949700 -1 osd.1 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:26.111112+0000 front 2019-11-25T15:38:27.052484+0000 (oldest deadline 2019-11-25T15:39:11.746173+0000) 2019-11-25T15:39:37.448 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:37.447+0000 16949700 -1 osd.1 174 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:37.529 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:39:37.524+0000 16949700 -1 osd.7 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.774873+0000 front 2019-11-25T15:38:25.678252+0000 (oldest deadline 2019-11-25T15:39:10.766708+0000) 2019-11-25T15:39:37.642 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:39:37.640+0000 16949700 -1 osd.2 174 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:38:25.126455+0000 front 2019-11-25T15:38:25.003209+0000 (oldest deadline 2019-11-25T15:39:09.897299+0000) 2019-11-25T15:39:38.847 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:38.748+0000 16949700 -1 osd.1 175 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:40.219 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:40.167+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:41.501 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:41.500+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:42.458 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:42.457+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:43.446 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:43.445+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:44.464 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:44.462+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:45.435 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:45.433+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:46.468 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:46.467+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:47.434 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:47.433+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:48.395 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:48.393+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:49.433 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:49.432+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:50.398 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:50.397+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:51.410 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:51.408+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:52.381 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:52.379+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:53.415 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:53.414+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:54.399 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:54.399+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:39:55.388 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:39:55.387+0000 16949700 -1 osd.1 176 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:109507 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-11-25T15:40:22.438 INFO:teuthology.orchestra.run.smithi135.stderr:testCopy (test.functional.tests.TestFile) ... ok 2019-11-25T15:40:24.577 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:15:37.725 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:40:24.583 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:15:37.730 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:40:24.586 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:15:37.838 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:40:24.593 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:15:37.741 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:40:24.597 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:15:37.848 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:40:24.599 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:15:37.747 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:40:24.877 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:15:38.128 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:40:24.891 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:15:38.040 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:40:24.910 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:15:38.058 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:40:35.945 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:35.942+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:35.956 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:35.952+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:36.775 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:36.770+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:36.933 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:36.929+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:36.999 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:36.995+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:37.411 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:37.408+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:37.781 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:37.777+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:37.944 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:37.940+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:38.000 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:37.997+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:38.288 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:38.286+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:38.453 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:38.451+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:38.829 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:38.826+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:38.929 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:38.925+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:39.048 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:39.046+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:39.340 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:39.338+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:39.473 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:39.472+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:39.843 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:39.839+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:39.923 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:39.920+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:40.044 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:40.042+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:40.392 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:40.389+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:40.518 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:40.516+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:40.828 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:40.822+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:40.972 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:40.968+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:41.049 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:41.047+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:41.368 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:41.366+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:41.519 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:41.518+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:41.822 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:41.818+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:41.983 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:41.978+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:42.015 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:42.013+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:42.412 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:42.409+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:42.527 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:42.525+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:42.847 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:42.843+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:43.028 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:43.025+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:43.051 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:43.048+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:43.406 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:43.404+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:43.549 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:43.548+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:43.849 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:43.845+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:44.011 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:44.009+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:44.061 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:44.058+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:44.393 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:44.390+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:44.546 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:44.544+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:44.847 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:44.842+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:44.987 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:44.983+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:45.035 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:45.030+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:45.401 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:45.399+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:45.584 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:45.582+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:45.836 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:45.831+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:45.943 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:45.940+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:46.087 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:46.083+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:46.421 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:46.419+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:46.568 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:46.565+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:46.823 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:46.819+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:46.972 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:46.969+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:47.119 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:47.115+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:47.403 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:47.401+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:47.598 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:47.595+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:47.851 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:47.846+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:48.014 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:48.013+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:48.077 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:48.072+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:48.414 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:48.411+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:48.565 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:48.563+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:48.863 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:48.860+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:49.055 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:49.051+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:49.064 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:49.062+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:49.444 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:49.441+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:49.598 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:49.597+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:49.846 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:49.842+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:50.090 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:50.087+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:50.100 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:50.095+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:50.488 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:50.486+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:50.634 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:50.632+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:50.833 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:50.828+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:51.132 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:51.130+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:51.151 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:51.146+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:51.520 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:51.517+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:51.610 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:51.608+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:51.855 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:51.851+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:52.143 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:52.141+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:52.182 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:52.178+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:52.526 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:52.523+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:52.568 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:40:52.564+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:40:52.645 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:52.643+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:52.671 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:40:52.669+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:40:52.818 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:52.812+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:53.152 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:53.149+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:53.161 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:53.157+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:53.536 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:53.535+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:53.578 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:40:53.575+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:40:53.652 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:53.650+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:53.711 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:40:53.709+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:40:53.830 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:53.826+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:54.118 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:54.113+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:54.136 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:54.134+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:54.494 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:54.491+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:54.595 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:40:54.591+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:40:54.669 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:40:54.666+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:40:54.699 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:54.697+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:54.874 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:54.871+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:55.084 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:55.080+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:55.179 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:55.176+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:55.451 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:55.447+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:55.574 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:40:55.571+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:40:55.665 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:55.662+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:55.688 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:40:55.684+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:40:55.878 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:55.875+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:56.105 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:56.101+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:56.196 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:56.193+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:56.431 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:56.428+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:56.604 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:40:56.600+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:40:56.667 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:56.662+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:56.736 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:40:56.732+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:40:56.925 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:56.921+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:57.114 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:57.110+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:57.187 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:57.184+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:57.463 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:57.460+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:57.569 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:40:57.565+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:40:57.663 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:57.660+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:57.735 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:40:57.732+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:40:57.906 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:57.903+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:58.075 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:58.071+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:58.235 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:58.231+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:58.469 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:58.466+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:58.602 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:40:58.595+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:40:58.647 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:58.644+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:58.694 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:40:58.690+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:40:58.945 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:58.941+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:40:59.118 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:40:59.114+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:40:59.220 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:40:59.213+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:40:59.521 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:40:59.519+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:40:59.621 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:40:59.617+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:40:59.638 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:40:59.635+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:40:59.719 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:40:59.716+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:40:59.939 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:40:59.935+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:41:00.116 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:41:00.112+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:41:00.184 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:41:00.181+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:41:00.506 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:41:00.502+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:41:00.601 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:41:00.598+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:41:00.655 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:41:00.645+0000 16949700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:40:19.843833+0000 (oldest deadline 2019-11-25T15:40:59.843833+0000) 2019-11-25T15:41:00.656 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:41:00.652+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:41:00.696 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:41:00.694+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:41:00.988 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:41:00.984+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:41:01.129 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:41:01.125+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:41:01.141 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:41:01.139+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:41:01.542 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:41:01.539+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:41:01.610 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:41:01.606+0000 16949700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:40:19.843833+0000 (oldest deadline 2019-11-25T15:40:59.843833+0000) 2019-11-25T15:41:01.611 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:41:01.607+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:41:01.655 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:41:01.652+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:41:01.749 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:41:01.747+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:41:01.970 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:41:01.964+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:41:02.131 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:41:02.127+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:41:02.132 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:41:02.127+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:41:02.532 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:41:02.528+0000 16949700 -1 osd.3 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.104271+0000 front 2019-11-25T15:39:54.002074+0000 (oldest deadline 2019-11-25T15:40:38.072115+0000) 2019-11-25T15:41:02.632 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:41:02.627+0000 16949700 -1 osd.5 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:40:19.843833+0000 (oldest deadline 2019-11-25T15:40:59.843833+0000) 2019-11-25T15:41:02.632 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:41:02.629+0000 16949700 -1 osd.5 180 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-11-25T15:41:02.683 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:41:02.680+0000 16949700 -1 osd.0 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:52.774119+0000 front 2019-11-25T15:39:53.846461+0000 (oldest deadline 2019-11-25T15:40:36.435367+0000) 2019-11-25T15:41:02.741 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:41:02.739+0000 16949700 -1 osd.1 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.113962+0000 front 2019-11-25T15:39:55.113213+0000 (oldest deadline 2019-11-25T15:40:52.349769+0000) 2019-11-25T15:41:02.976 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:41:02.971+0000 16949700 -1 osd.6 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:55.069168+0000 front 2019-11-25T15:39:55.077636+0000 (oldest deadline 2019-11-25T15:40:36.758566+0000) 2019-11-25T15:41:03.095 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:41:03.091+0000 16949700 -1 osd.7 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:51.273946+0000 front 2019-11-25T15:39:51.264921+0000 (oldest deadline 2019-11-25T15:40:35.175530+0000) 2019-11-25T15:41:03.107 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:41:03.105+0000 16949700 -1 osd.2 180 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:39:53.573429+0000 front 2019-11-25T15:39:53.501140+0000 (oldest deadline 2019-11-25T15:40:35.027396+0000) 2019-11-25T15:42:03.440 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:17:16.588 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:42:03.464 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:17:16.613 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:42:03.500 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:17:16.648 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:42:03.501 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:17:16.650 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:42:03.503 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:17:16.754 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:42:03.531 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:17:16.783 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:42:03.582 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:17:16.730 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:42:03.603 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:17:16.751 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:42:03.668 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:17:16.920 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:42:04.454 INFO:teuthology.orchestra.run.smithi135.stderr:testCopy404s (test.functional.tests.TestFile) ... ok 2019-11-25T15:42:05.528 INFO:teuthology.orchestra.run.smithi135.stderr:testCopyDestinationSlashProblems (test.functional.tests.TestFile) ... ok 2019-11-25T15:42:24.022 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:42:24.019+0000 16949700 -1 osd.4 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:109901 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821484416 gen 71] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-11-25T15:42:25.038 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:42:25.036+0000 16949700 -1 osd.4 185 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4509.0:109901 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821484416 gen 71] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-11-25T15:42:26.079 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:42:26.077+0000 16949700 -1 osd.4 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:109903 5.3 5:c609908c:::notify.5:head [watch reconnect cookie 821687328 gen 71] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-11-25T15:42:40.967 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:42:40.795+0000 39a79700 -1 osd.5 185 build_incremental_map_msg missing incremental map 168 2019-11-25T15:42:49.286 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:42:49.283+0000 3aa7b700 -1 osd.4 185 build_incremental_map_msg missing incremental map 163 2019-11-25T15:42:49.289 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:42:49.286+0000 3aa7b700 -1 osd.4 185 build_incremental_map_msg missing incremental map 174 2019-11-25T15:42:58.474 INFO:teuthology.orchestra.run.smithi135.stderr:testCopyFromHeader (test.functional.tests.TestFile) ... ok 2019-11-25T15:43:00.212 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:00.209+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:01.179 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:01.175+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:01.215 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:01.211+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:02.084 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:02.079+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:02.195 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:02.192+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:02.250 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:02.246+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:02.504 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:02.500+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:03.116 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:03.111+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:03.196 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:03.194+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:03.214 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:03.211+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:03.311 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:03.308+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:03.319 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:03.316+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:03.475 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:03.474+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:04.106 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:04.100+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:04.203 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:04.199+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:04.203 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:04.197+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:04.275 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:04.272+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:04.353 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:04.348+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:04.455 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:04.453+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:04.882 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:04.878+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:05.157 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:05.153+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:05.226 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:05.223+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:05.251 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:05.248+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:05.252 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:05.248+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:05.313 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:05.310+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:05.472 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:05.469+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:05.919 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:05.917+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:06.141 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:06.137+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:06.217 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:06.215+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:06.271 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:06.268+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:06.273 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:06.268+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:06.308 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:06.304+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:06.497 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:06.495+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:06.962 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:06.959+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:07.113 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:07.109+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:07.205 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:07.202+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:07.268 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:07.263+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:07.279 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:07.275+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:07.332 INFO:teuthology.orchestra.run.smithi135.stderr:testCopyFromHeader404s (test.functional.tests.TestFile) ... ok 2019-11-25T15:43:07.363 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:07.358+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:07.454 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:07.453+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:07.944 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:07.942+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:08.166 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:08.161+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:08.251 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:08.249+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:08.257 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:08.255+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:08.261 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:08.257+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:08.387 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:08.383+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:08.474 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:08.472+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:08.985 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:08.982+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:09.197 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:09.194+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:09.275 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:09.271+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:09.284 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:09.282+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:09.286 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:09.284+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:09.448 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:09.441+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:09.495 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:09.493+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:09.942 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:09.939+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:10.182 INFO:teuthology.orchestra.run.smithi135.stderr:testCopyNoDestinationHeader (test.functional.tests.TestFile) ... ok 2019-11-25T15:43:10.244 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:10.239+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:10.257 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:10.255+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:10.272 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:10.268+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:10.319 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:10.317+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:10.412 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:10.408+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:10.459 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:10.456+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:10.955 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:10.951+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:11.215 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:11.211+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:11.237 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:11.234+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:11.278 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:11.275+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:11.322 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:11.319+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:11.427 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:11.423+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:11.449 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:11.444+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:11.917 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:11.913+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:12.243 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:12.239+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:12.250 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:12.246+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:12.307 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:12.303+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:12.332 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:12.328+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:12.403 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:12.400+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:12.413 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:12.410+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:12.895 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:12.891+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:13.235 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:13.232+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:13.267 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:13.264+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:13.311 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:13.307+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:13.385 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:13.381+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:13.464 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:13.461+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:13.532 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:13.529+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:13.923 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:13.920+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:14.213 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:14.209+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:14.226 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:14.221+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:14.320 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:14.316+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:14.361 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:14.358+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:14.476 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:14.472+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:14.548 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:14.537+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:14.972 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:14.968+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:15.182 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:15.179+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:15.256 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:15.254+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:15.334 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:15.329+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:15.362 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:15.358+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:15.500 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:15.497+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:15.522 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:15.518+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:15.949 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:15.945+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:16.207 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:16.203+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:16.307 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:16.306+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:16.337 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:16.333+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:16.396 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:16.391+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:16.503 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:16.501+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:16.518 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:16.514+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:16.934 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:16.932+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:17.185 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:17.181+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:17.266 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:17.264+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:17.354 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:17.351+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:17.420 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:17.417+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:17.530 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:17.528+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:17.545 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:17.544+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:17.891 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:17.888+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:18.171 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:18.167+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:18.220 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:18.218+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:18.337 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:18.333+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:18.452 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:18.448+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:18.545 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:18.542+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:18.575 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:18.572+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:18.917 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:18.915+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:19.202 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:19.198+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:19.251 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:19.248+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:19.360 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:19.356+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:19.429 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:19.425+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:19.524 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:19.521+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:19.543 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:19.540+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:19.907 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:19.904+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:20.194 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:20.191+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:20.236 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:20.234+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:20.353 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:20.349+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:20.397 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:20.393+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:20.537 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:20.534+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:20.548 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:20.544+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:20.906 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:20.903+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:21.149 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:21.146+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:21.235 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:21.232+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:21.446 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:21.443+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:21.502 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:21.493+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:21.587 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:21.585+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:21.667 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:21.656+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:21.901 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:21.898+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:22.186 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:22.182+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:22.273 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:22.271+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:22.491 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:22.486+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:22.549 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:22.546+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:22.551 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:22.549+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:22.655 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:22.653+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:22.895 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:22.893+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:23.202 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:23.197+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:23.248 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:23.246+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:23.456 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:23.450+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:23.533 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:23.531+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:23.551 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:23.547+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:23.756 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:23.743+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:23.934 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:23.932+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:24.194 INFO:teuthology.orchestra.run.smithi135.stderr:testDelete (test.functional.tests.TestFile) ... ok 2019-11-25T15:43:24.197 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:24.193+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:24.255 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:24.253+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:24.490 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:24.486+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:24.493 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:24.491+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:24.594 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:24.590+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:24.983 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:24.980+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:25.002 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:25.000+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:25.036 INFO:teuthology.orchestra.run.smithi135.stderr:testDeleteOfFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-25T15:43:25.169 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:25.165+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:25.222 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:25.220+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:25.490 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:25.486+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:25.534 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:25.531+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:25.616 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:25.612+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:25.962 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:25.958+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:26.003 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:26.000+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:26.209 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:26.207+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:26.216 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:26.211+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:26.537 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:26.535+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:26.540 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:26.536+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:26.636 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:26.633+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:26.965 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:26.962+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:27.038 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:27.036+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:27.208 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:27.204+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:27.233 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:27.230+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:27.541 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:27.539+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:27.592 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:27.589+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:27.663 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:27.660+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:27.998 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:27.996+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:28.001 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:27.999+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:28.213 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:28.210+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:28.263 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:28.260+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:28.579 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:28.576+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:28.613 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:28.610+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:28.689 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:28.686+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:28.960 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:28.958+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:29.028 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:29.026+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:29.266 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:29.265+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:29.277 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:29.273+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:29.619 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:29.611+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:29.666 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:29.663+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:29.731 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:29.728+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:29.937 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:29.936+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:30.004 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:30.000+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:30.224 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:30.222+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:30.306 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:30.303+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:30.623 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:30.620+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:30.660 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:30.658+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:30.747 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:30.743+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:30.979 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:30.977+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:30.981 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:30.978+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:31.212 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:31.211+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:31.308 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:31.307+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:31.630 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:31.628+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:31.659 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:31.655+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:31.721 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:31.717+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:31.977 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:31.975+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:31.985 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:31.983+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:32.189 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:32.186+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:32.279 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:32.277+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:32.592 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:32.590+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:32.649 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:32.646+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:32.691 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:32.688+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:32.959 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:32.956+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:32.986 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:32.983+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:33.146 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:33.144+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:33.285 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:33.282+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:33.572 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:33.570+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:33.668 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:33.665+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:33.683 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:33.679+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:33.731 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:43:33.710+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 47sec e185 v185) 2019-11-25T15:43:33.923 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:33.921+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:33.963 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:33.960+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:34.168 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:34.166+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:34.262 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:34.259+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:34.593 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:34.590+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:34.677 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:34.674+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:34.731 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:34.729+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:34.910 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:34.908+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:34.931 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:34.929+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:35.188 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:35.185+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:35.278 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:35.275+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:35.643 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:35.640+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:35.722 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:35.719+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:35.729 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:35.726+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:35.891 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:35.888+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:35.971 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:35.968+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:36.143 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:36.140+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:36.331 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:36.328+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:36.684 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:36.682+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:36.684 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:36.681+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:36.771 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:36.767+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:36.854 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:36.851+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:36.940 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:36.937+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:37.140 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:37.138+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:37.365 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:37.363+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:37.645 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:37.642+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:37.720 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:37.718+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:37.761 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:37.758+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:37.855 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:37.853+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:43:37.902 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:43:37.899+0000 16949700 -1 osd.1 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.049590+0000 front 2019-11-25T15:42:18.051994+0000 (oldest deadline 2019-11-25T15:43:03.264613+0000) 2019-11-25T15:43:38.109 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:43:38.106+0000 16949700 -1 osd.0 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:16.629731+0000 front 2019-11-25T15:42:17.451660+0000 (oldest deadline 2019-11-25T15:43:00.175583+0000) 2019-11-25T15:43:38.350 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:43:38.347+0000 16949700 -1 osd.7 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.400604+0000 front 2019-11-25T15:42:19.379500+0000 (oldest deadline 2019-11-25T15:43:01.806382+0000) 2019-11-25T15:43:38.660 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:43:38.657+0000 16949700 -1 osd.2 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:19.466325+0000 front 2019-11-25T15:42:23.195500+0000 (oldest deadline 2019-11-25T15:43:02.088882+0000) 2019-11-25T15:43:38.726 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:43:38.723+0000 16949700 -1 osd.4 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:23.193136+0000 front 2019-11-25T15:42:22.708654+0000 (oldest deadline 2019-11-25T15:43:02.678974+0000) 2019-11-25T15:43:38.768 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:43:38.765+0000 16949700 -1 osd.6 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:14.757690+0000 front 2019-11-25T15:42:15.005552+0000 (oldest deadline 2019-11-25T15:42:59.371803+0000) 2019-11-25T15:43:38.798 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:43:38.793+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 47sec e185 v185) 2019-11-25T15:43:38.831 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:43:38.828+0000 16949700 -1 osd.3 185 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:42:18.327476+0000 front 2019-11-25T15:42:18.300789+0000 (oldest deadline 2019-11-25T15:43:04.105022+0000) 2019-11-25T15:44:06.595 INFO:teuthology.orchestra.run.smithi135.stderr:testDeleteThen404s (test.functional.tests.TestFile) ... ok 2019-11-25T15:44:08.339 INFO:teuthology.orchestra.run.smithi135.stderr:testEtagResponse (test.functional.tests.TestFile) ... ok 2019-11-25T15:44:08.412 INFO:teuthology.orchestra.run.smithi135.stderr:testEtagWayoff (test.functional.tests.TestFile) ... ok 2019-11-25T15:44:21.962 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:19:35.110 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:44:21.977 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:19:35.125 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:44:21.989 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:19:35.137 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:44:21.991 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:19:35.140 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:44:21.993 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:19:35.244 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:44:22.003 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:19:35.254 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:44:22.131 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:19:35.279 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:44:22.148 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:19:35.296 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:44:22.168 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:19:35.419 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:44:37.050 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:37.046+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:37.083 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:37.079+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:38.070 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:38.068+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:38.112 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:38.109+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:38.737 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:38.735+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:39.060 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:39.058+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:39.077 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:39.074+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:39.107 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:39.104+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:39.696 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:39.693+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:39.756 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:39.753+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:40.067 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:40.065+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:40.085 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:40.082+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:40.097 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:40.094+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:40.117 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:40.114+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:40.740 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:40.737+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:40.759 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:40.756+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:41.078 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:41.074+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:41.124 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:41.089+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:41.124 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:41.121+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:41.148 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:41.145+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:41.746 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:41.741+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:41.754 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:41.750+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:42.054 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:42.051+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:42.104 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:42.101+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:42.150 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:42.145+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:42.160 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:42.157+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:42.726 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:42.721+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:42.733 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:42.727+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:43.024 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:43.020+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:43.121 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:43.118+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:43.139 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:43.134+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:43.159 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:43.156+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:43.687 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:43.683+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:43.773 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:43.768+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:44.068 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:44.065+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:44.106 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:44.103+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:44.157 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:44.153+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:44.171 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:44.168+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:44.740 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:44.734+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:44.817 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:44.813+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:45.081 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:45.077+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:45.097 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:45.095+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:45.113 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:45.109+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:45.196 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:45.193+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:45.746 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:45.744+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:45.857 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:45.855+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:46.059 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:46.054+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:46.092 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:46.090+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:46.168 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:46.164+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:46.227 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:46.222+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:46.726 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:46.724+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:46.898 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:46.895+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:47.112 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:47.108+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:47.116 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:47.114+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:47.178 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:47.175+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:47.184 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:47.180+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:47.689 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:47.687+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:47.853 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:47.850+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:48.130 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:48.125+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:48.135 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:48.132+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:48.187 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:48.184+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:48.204 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:48.200+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:48.654 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:48.652+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:48.839 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:48.837+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:49.096 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:49.092+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:49.180 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:49.178+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:49.181 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:49.176+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:49.203 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:49.201+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:49.706 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:49.704+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:49.849 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:49.846+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:49.897 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:49.893+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:44:50.051 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:50.047+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:50.148 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:50.144+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:50.180 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:50.178+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:50.225 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:50.223+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:50.739 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:50.735+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:50.867 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:50.864+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:50.924 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:50.921+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:44:51.036 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:51.032+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:51.117 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:51.113+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:51.142 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:51.140+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:51.199 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:51.189+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:51.753 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:51.750+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:51.915 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:51.913+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:51.953 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:51.950+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:44:52.033 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:52.029+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:52.148 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:52.144+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:52.149 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:52.147+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:52.283 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:52.281+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:52.766 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:52.764+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:52.950 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:52.946+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:44:52.959 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:52.956+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:53.017 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:53.014+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:53.126 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:53.121+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:53.193 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:53.191+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:53.264 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:53.261+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:53.751 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:53.749+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:53.940 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:53.937+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:53.982 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:53.978+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:44:54.026 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:54.017+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:54.121 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:54.118+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:54.149 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:54.146+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:54.284 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:54.281+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:54.716 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:54.713+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:54.945 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:54.941+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:44:54.949 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:54.947+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:54.985 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:54.980+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:55.107 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:55.103+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:55.194 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:55.192+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:55.248 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:55.244+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:55.674 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:55.672+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:55.939 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:55.935+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:44:55.940 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:55.936+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:44:55.977 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:55.973+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:55.983 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:55.979+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:56.064 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:56.060+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:56.170 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:56.166+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:56.232 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:56.230+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:56.639 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:56.636+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:56.943 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:56.938+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:56.945 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:56.941+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:44:56.949 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:56.945+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:44:57.003 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:56.999+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:57.019 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:57.015+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:57.152 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:57.150+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:57.272 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:57.270+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:57.649 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:57.647+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:57.970 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:57.968+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:57.984 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:57.979+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:57.998 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:57.982+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:44:58.003 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:57.995+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:44:58.053 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:58.048+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:58.115 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:58.112+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:58.290 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:58.288+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:58.628 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:58.625+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:58.951 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:58.948+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:58.954 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:58.950+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:58.988 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:58.983+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:44:58.989 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:58.985+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:44:59.053 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:44:59.049+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:44:59.110 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:44:59.108+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:44:59.302 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:44:59.299+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:44:59.607 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:44:59.605+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:44:59.921 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:44:59.919+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:44:59.981 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:44:59.977+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:44:59.996 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:59.992+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:00.001 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:44:59.996+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:00.088 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:00.084+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:00.121 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:00.118+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:00.310 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:00.308+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:00.569 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:00.564+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:00.967 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:00.964+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:01.003 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:00.999+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:01.005 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:01.002+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:01.008 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:01.003+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:01.082 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:01.078+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:01.082 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:01.079+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:01.362 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:01.360+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:01.554 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:01.551+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:01.928 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:01.925+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:02.037 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:02.033+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:02.049 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:02.045+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:02.050 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:02.046+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:02.111 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:02.108+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:02.143 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:02.139+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:02.334 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:02.331+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:02.524 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:02.522+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:02.959 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:02.956+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:03.018 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:03.013+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:03.019 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:03.016+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:03.089 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:03.086+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:03.093 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:03.089+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:03.133 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:03.129+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:03.314 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:03.311+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:03.508 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:03.505+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:03.931 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:03.928+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:03.991 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:03.987+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:03.995 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:03.992+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:04.097 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:04.094+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:04.109 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:04.104+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:04.127 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:04.123+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:04.335 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:04.333+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:04.557 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:04.554+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:04.910 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:04.907+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:05.002 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:04.996+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:05.002 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:04.998+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:05.096 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:05.092+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:05.105 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:05.101+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:05.125 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:05.121+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:05.375 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:05.373+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:05.595 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:05.593+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:05.950 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:05.947+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:06.022 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:06.016+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:06.022 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:06.019+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:06.071 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:06.068+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:06.111 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:06.107+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:06.151 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:06.149+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:06.400 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:06.398+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:06.573 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:06.571+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:06.924 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:06.917+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:06.999 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:06.994+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:07.000 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:06.996+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:07.033 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:07.029+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:07.113 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:07.105+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:07.165 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:07.162+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:07.383 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:07.381+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:07.624 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:07.622+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:07.888 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:07.885+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:08.019 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:08.015+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:08.027 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:08.019+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:08.066 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:08.061+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:08.108 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:08.105+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:08.177 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:08.174+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:08.397 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:08.393+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:08.638 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:08.635+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:08.927 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:08.924+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:09.051 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:45:09.047+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 40sec e192 v192) 2019-11-25T15:45:09.055 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:09.051+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:09.059 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:09.056+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:09.065 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:09.061+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:09.123 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:09.119+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:09.165 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:09.161+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:09.445 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:09.443+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:09.635 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:09.633+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:09.922 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:09.919+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:10.033 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:10.028+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:10.070 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:10.065+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:10.071 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:10.067+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:10.154 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:10.153+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:10.185 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:10.182+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:10.492 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:10.489+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:10.683 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:10.679+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:10.907 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:10.904+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:11.002 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:10.998+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:11.055 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:11.052+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:11.056 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:11.054+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:11.143 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:11.140+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:11.190 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:11.186+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:11.528 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:11.525+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:11.694 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:11.692+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:11.881 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:11.878+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:11.970 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:11.965+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:12.021 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:12.017+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:12.024 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:12.021+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:12.119 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:12.115+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:12.158 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:12.153+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:12.528 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:12.526+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:12.657 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:12.654+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:12.844 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:12.842+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:12.940 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:12.935+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:13.000 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:12.997+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:13.003 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:13.000+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:13.115 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:13.113+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:13.167 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:13.162+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:13.503 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:13.497+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:13.701 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:13.699+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:13.826 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:13.823+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:13.983 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:13.978+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:13.992 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:13.989+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:13.995 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:13.992+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:14.066 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:45:14.062+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 40sec e192 v192) 2019-11-25T15:45:14.117 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:14.115+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:14.122 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:14.119+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:14.515 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:14.513+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:14.671 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:14.669+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:14.796 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:14.793+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:14.964 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:14.958+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:14.964 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:14.960+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:15.030 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:15.025+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:15.111 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:15.107+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:15.159 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:15.156+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:15.487 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:15.484+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:15.672 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:15.670+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:15.780 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:15.778+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:15.923 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:15.919+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:15.925 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:15.922+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:16.058 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:16.053+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:16.149 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:16.145+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:16.177 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:16.174+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:16.473 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:16.469+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:16.717 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:16.714+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:16.784 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:16.781+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:16.958 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:16.954+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:16.961 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:16.958+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:17.034 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:17.030+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:17.154 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:17.151+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:17.181 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:17.177+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:17.521 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:17.518+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:17.759 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:17.755+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:17.778 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:17.773+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:17.967 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:17.962+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:17.967 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:17.964+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:18.007 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:18.003+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:18.166 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:18.163+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:18.189 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:18.185+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:18.563 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:18.559+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:18.723 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:18.720+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:18.771 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:18.768+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:19.015 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:19.010+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:19.016 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:19.012+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:19.023 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:19.017+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:19.086 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:45:19.078+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 40sec e192 v192) 2019-11-25T15:45:19.190 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:19.188+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:19.243 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:19.239+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:19.610 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:19.608+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:19.774 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:19.771+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:19.775 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:19.772+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:20.002 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:19.997+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:20.003 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:19.999+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:20.072 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:20.068+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:20.163 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:20.161+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:20.203 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:20.199+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:20.621 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:20.619+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:20.749 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:20.744+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:20.805 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:20.803+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:20.958 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:20.954+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:20.961 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:20.958+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:21.062 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:21.058+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:21.136 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:21.133+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:21.163 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:21.159+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:21.631 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:21.628+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:21.767 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:21.765+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:21.782 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:21.779+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:21.945 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:21.940+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:21.946 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:21.941+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:22.100 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:22.095+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:22.116 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:22.114+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:22.162 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:22.157+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:22.602 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:22.600+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:22.822 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:22.818+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:22.824 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:22.822+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:22.958 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:22.953+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:22.959 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:22.955+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:23.056 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:23.051+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:23.113 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:23.111+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:23.219 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:23.213+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:23.613 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:23.610+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:23.779 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:23.777+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:23.878 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:23.875+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:23.893 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:23.888+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:23.981 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:23.974+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:23.982 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:23.976+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:24.062 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:24.058+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:24.095 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:24.092+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:24.106 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:45:24.099+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 40sec e192 v192) 2019-11-25T15:45:24.260 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:24.256+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:24.626 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:24.623+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:24.741 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:24.739+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:24.860 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:24.858+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:24.863 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:24.862+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:24.957 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:24.952+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:24.958 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:24.954+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:25.027 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:25.022+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:25.130 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:25.127+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:25.308 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:25.303+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:25.645 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:25.643+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:25.737 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:25.735+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:25.847 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:25.845+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:25.849 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:25.846+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:25.951 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:25.947+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:25.952 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:25.948+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:26.025 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:26.021+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:26.123 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:26.119+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:26.343 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:26.338+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:26.641 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:26.636+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:26.729 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:26.725+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:26.804 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:26.800+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:26.805 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:26.803+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:26.951 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:26.947+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:26.954 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:26.951+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:27.030 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:27.026+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:27.158 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:27.155+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:27.375 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:27.372+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:27.613 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:27.608+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:27.765 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:27.760+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:27.765 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:27.760+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:27.768 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:27.762+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:28.008 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:28.003+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:28.008 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:28.004+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:28.066 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:28.061+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:28.164 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:28.161+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:28.336 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:28.332+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:28.594 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:28.590+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:28.742 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:28.739+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:28.744 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:28.740+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:28.744 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:28.741+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:28.967 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:28.963+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:28.970 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:28.967+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:29.028 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:29.023+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:29.123 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:29.119+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:29.125 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:45:29.122+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 40sec e192 v192) 2019-11-25T15:45:29.359 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:29.355+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:29.614 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:29.611+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:29.702 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:29.699+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:29.718 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:29.714+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:29.719 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:29.716+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:29.925 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:29.920+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:29.926 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:29.922+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:30.080 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:30.074+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:30.142 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:30.138+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:30.410 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:30.405+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:30.646 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:30.643+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:30.675 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:30.671+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:30.676 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:30.673+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:30.693 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:30.689+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:30.898 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:30.894+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:30.901 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:30.898+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:31.064 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:31.060+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:31.134 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:31.132+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:31.404 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:31.400+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:31.683 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:31.680+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:31.734 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:31.724+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:31.745 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:31.726+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:31.747 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:31.744+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:31.933 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:31.929+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:31.935 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:31.930+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:32.117 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:32.112+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:32.157 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:32.154+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:32.357 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:32.353+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:32.690 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:32.688+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:32.692 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:32.691+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:32.698 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:32.696+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:32.765 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:32.762+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:32.931 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:32.927+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:32.933 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:32.930+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:33.124 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:33.121+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:33.150 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:33.146+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:33.390 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:45:33.385+0000 16949700 -1 osd.7 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:56.181778+0000 front 2019-11-25T15:43:56.167744+0000 (oldest deadline 2019-11-25T15:44:36.717619+0000) 2019-11-25T15:45:33.736 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:33.734+0000 16949700 -1 osd.0 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.536319+0000 front 2019-11-25T15:43:53.628887+0000 (oldest deadline 2019-11-25T15:44:37.523566+0000) 2019-11-25T15:45:33.737 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:33.735+0000 16949700 -1 osd.0 192 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:33.741 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:45:33.738+0000 16949700 -1 osd.1 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:55.042362+0000 front 2019-11-25T15:43:55.217750+0000 (oldest deadline 2019-11-25T15:44:39.664145+0000) 2019-11-25T15:45:33.812 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:45:33.809+0000 16949700 -1 osd.3 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:53.630267+0000 front 2019-11-25T15:43:53.629293+0000 (oldest deadline 2019-11-25T15:44:38.837222+0000) 2019-11-25T15:45:33.904 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:33.900+0000 16949700 -1 osd.5 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:44:15.653517+0000 (oldest deadline 2019-11-25T15:44:55.653517+0000) 2019-11-25T15:45:33.907 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:33.903+0000 16949700 -1 osd.5 192 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:34.118 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:45:34.114+0000 16949700 -1 osd.6 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.236385+0000 front 2019-11-25T15:43:54.077398+0000 (oldest deadline 2019-11-25T15:44:38.536210+0000) 2019-11-25T15:45:34.180 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:45:34.177+0000 16949700 -1 osd.2 192 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:43:54.254739+0000 front 2019-11-25T15:43:54.238009+0000 (oldest deadline 2019-11-25T15:44:36.511577+0000) 2019-11-25T15:45:34.211 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:45:34.205+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 40sec e192 v192) 2019-11-25T15:45:35.024 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:34.997+0000 16949700 -1 osd.0 193 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:35.067 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:45:35.001+0000 16949700 -1 osd.5 193 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e189) 2019-11-25T15:45:36.121 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:36.116+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:37.083 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:37.082+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:38.085 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:38.083+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:39.065 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:39.064+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:40.101 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:40.098+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:41.057 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:41.056+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:42.052 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:42.051+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:43.054 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:43.053+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:44.012 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:44.009+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:44.992 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:44.990+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:46.028 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:46.026+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:47.051 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:47.049+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:48.093 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:48.090+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:49.077 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:49.075+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:50.076 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:50.075+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:51.038 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:45:51.036+0000 16949700 -1 osd.0 194 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:110370 2.11s0 2:89e31bd8:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650_f925ad13417b40049d2acb0cb5ba97e5:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~21753 in=21753b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.content_type (25) in=46b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e192) 2019-11-25T15:45:53.928 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:45:53.792+0000 28256700 -1 reset not still connected to 0x26b0fd60 2019-11-25T15:45:53.929 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:45:53.794+0000 28256700 -1 reset not still connected to 0x3bd55e10 2019-11-25T15:46:19.516 INFO:teuthology.orchestra.run.smithi135.stderr:testFileCreate (test.functional.tests.TestFile) ... ok 2019-11-25T15:46:26.801 INFO:teuthology.orchestra.run.smithi135.stderr:testGetContentType (test.functional.tests.TestFile) ... ok 2019-11-25T15:46:27.466 INFO:teuthology.orchestra.run.smithi135.stderr:testGetOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-25T15:46:31.482 INFO:teuthology.orchestra.run.smithi135.stderr:testHead (test.functional.tests.TestFile) ... ok 2019-11-25T15:46:33.736 INFO:teuthology.orchestra.run.smithi135.stderr:testHeadOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-25T15:47:06.584 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:06.582+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:06.691 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:06.688+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:06.715 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:06.713+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:07.045 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:07.039+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:07.539 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:07.537+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:07.654 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:07.649+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:07.708 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:07.706+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:07.738 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:07.735+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:08.099 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:08.094+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:08.404 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:08.400+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:08.551 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:08.549+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:08.683 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:08.678+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:08.703 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:08.698+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:08.740 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:08.737+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:09.040 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:09.035+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:09.112 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:09.108+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:09.435 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:09.429+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:09.536 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:09.533+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:09.674 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:09.672+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:09.700 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:09.697+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:09.739 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:09.737+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:10.040 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:10.036+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:10.155 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:10.150+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:10.478 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:10.474+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:10.510 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:10.506+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:10.674 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:10.671+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:10.742 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:10.741+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:10.744 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:10.705+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:11.017 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:11.013+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:11.175 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:11.170+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:11.478 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:11.474+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:11.481 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:11.478+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:11.668 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:11.667+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:11.685 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:11.683+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:11.715 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:11.713+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:12.019 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:12.015+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:12.184 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:12.179+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:12.467 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:12.464+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:12.513 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:12.508+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:12.682 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:12.679+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:12.704 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:12.702+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:12.733 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:12.704+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:12.995 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:12.992+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:13.146 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:13.142+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:13.450 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:13.447+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:13.520 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:13.515+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:13.664 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:13.662+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:13.724 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:13.720+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:13.728 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:13.725+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:14.008 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:14.004+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:14.115 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:14.112+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:14.472 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:14.469+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:14.539 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:14.534+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:14.715 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:14.712+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:14.716 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:14.714+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:14.749 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:14.747+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:15.011 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:15.007+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:15.100 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:15.095+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:15.477 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:15.473+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:15.527 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:15.522+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:15.711 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:15.709+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:15.756 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:15.753+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:15.759 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:15.756+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:16.021 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:16.016+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:16.103 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:16.098+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:16.491 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:16.487+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:16.509 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:16.505+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:16.739 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:16.736+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:16.767 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:16.764+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:16.836 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:16.816+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:17.059 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:17.056+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:17.120 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:17.116+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:17.476 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:17.472+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:17.494 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:17.491+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:17.738 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:17.736+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:17.766 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:17.763+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:17.863 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:17.861+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:18.076 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:18.071+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:18.125 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:18.121+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:18.435 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:18.431+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:18.480 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:18.477+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:18.733 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:18.731+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:18.734 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:18.732+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:18.883 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:18.881+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:19.114 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:19.110+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:19.119 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:19.115+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:19.421 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:19.416+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:19.434 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:19.433+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:19.706 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:19.704+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:19.751 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:19.746+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:20.137 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:20.134+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:20.142 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:20.139+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:20.155 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:20.151+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:20.402 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:20.398+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:20.417 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:20.412+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:20.676 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:20.673+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:20.766 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:20.764+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:21.148 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:21.145+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:21.156 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:21.151+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:21.184 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:21.179+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:21.420 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:21.417+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:21.432 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:21.428+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:21.706 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:21.704+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:21.791 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:21.789+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:22.184 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:22.180+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:22.185 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:22.180+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:22.207 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:22.189+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:22.446 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:22.443+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:22.450 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:22.446+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:22.693 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:22.689+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:22.768 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:22.765+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:23.147 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:23.143+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:23.217 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:23.199+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:23.238 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:23.234+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:23.435 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:23.432+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:23.462 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:23.458+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:23.687 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:23.684+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:23.788 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:23.786+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:24.189 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:24.185+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:24.218 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:24.213+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:24.412 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:24.409+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:24.492 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:24.487+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:24.528 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:24.522+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:24.741 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:24.738+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:24.838 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:24.835+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:25.154 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:25.150+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:25.215 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:25.211+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:25.369 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:25.366+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:25.469 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:25.464+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:25.525 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:25.523+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:25.707 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:25.704+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:25.829 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:25.827+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:26.191 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:26.187+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:26.197 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:26.193+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:26.365 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:26.362+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:26.468 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:26.464+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:26.565 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:26.563+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:26.664 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:26.661+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:26.864 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:26.862+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:27.170 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:27.166+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:27.172 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:27.168+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:27.372 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:27.368+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:27.424 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:27.419+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:27.698 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:27.695+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:27.730 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:27.728+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:27.830 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:27.829+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:28.139 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:28.135+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:28.193 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:28.189+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:28.373 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:28.372+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:28.459 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:28.455+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:28.664 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:28.661+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:28.842 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:28.839+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:28.984 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:28.882+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:29.106 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:29.101+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:29.249 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:29.244+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:29.366 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:29.363+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:29.478 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:29.474+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:29.713 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:29.710+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:29.805 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:29.801+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:29.979 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:29.977+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:30.097 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:30.092+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:30.280 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:30.275+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:30.350 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:30.347+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:30.498 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:30.494+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:30.695 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:30.692+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:30.790 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:30.788+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:30.941 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:30.939+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:31.135 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:31.130+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:31.313 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:31.309+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:31.346 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:31.343+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:31.471 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:31.468+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:31.703 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:31.700+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:31.819 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:31.815+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:32.153 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:32.149+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:32.222 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:32.192+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:32.321 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:32.317+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:32.381 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:32.378+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:32.446 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:32.442+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:32.675 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:32.672+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:32.855 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:32.852+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:33.017 INFO:teuthology.orchestra.run.smithi135.stderr:testMetadataOnPost (test.functional.tests.TestFile) ... ok 2019-11-25T15:47:33.191 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:33.188+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:33.201 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:33.197+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:33.345 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:33.343+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:33.367 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:33.363+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:33.440 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:33.436+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:33.725 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:33.722+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:33.843 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:33.841+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:34.153 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:34.150+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:34.252 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:34.247+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:34.360 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:34.355+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:34.377 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:34.373+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:34.415 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:34.411+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:34.772 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:34.766+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:34.893 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:34.892+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:35.191 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:35.188+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:35.303 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:35.299+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:35.357 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:35.354+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:35.365 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:35.362+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:35.384 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:35.381+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:35.811 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:35.809+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:35.862 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:35.860+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:36.198 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:36.195+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:36.313 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:36.308+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:36.385 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:36.381+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:36.399 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:36.395+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:36.415 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:36.412+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:36.806 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:36.804+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:36.894 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:36.891+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:37.330 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:37.325+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:37.356 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:37.352+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:37.369 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:37.367+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:37.373 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:37.369+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:37.446 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:37.407+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:37.855 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:37.853+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:37.927 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:37.925+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:38.321 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:38.316+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:38.329 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:38.326+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:38.358 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:38.355+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:38.373 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:38.369+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:38.444 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:38.442+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:38.878 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:38.875+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:38.951 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:38.948+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:39.320 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:39.316+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:39.325 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:39.320+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:39.368 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:39.365+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:39.370 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:39.365+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:39.472 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:39.470+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:39.910 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:39.907+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:39.929 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:39.927+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:40.274 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:40.270+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:40.293 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:40.289+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:40.348 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:40.346+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:40.365 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:40.360+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:40.506 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:40.504+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:40.915 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:40.912+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:40.957 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:40.954+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:41.252 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:41.248+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:41.300 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:41.296+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:41.338 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:41.333+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:41.383 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:41.381+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:41.572 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:41.553+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:41.974 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:41.971+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:41.975 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:41.972+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:42.223 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:42.218+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:42.297 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:42.293+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:42.328 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:42.323+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:42.398 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:42.394+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:42.819 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:42.815+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:42.955 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:42.951+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:42.994 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:42.991+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:43.222 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:43.218+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:43.287 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:43.283+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:43.323 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:43.318+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:43.370 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:43.365+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:43.823 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:43.819+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:47:43.956 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:47:43.951+0000 16949700 -1 osd.3 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.794113+0000 front 2019-11-25T15:46:24.471609+0000 (oldest deadline 2019-11-25T15:47:06.359837+0000) 2019-11-25T15:47:43.968 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:47:43.965+0000 16949700 -1 osd.0 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.460291+0000 front 2019-11-25T15:46:24.787980+0000 (oldest deadline 2019-11-25T15:47:06.309606+0000) 2019-11-25T15:47:44.232 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:47:44.228+0000 16949700 -1 osd.7 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:24.220785+0000 front 2019-11-25T15:46:23.843939+0000 (oldest deadline 2019-11-25T15:47:08.138611+0000) 2019-11-25T15:47:44.306 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:47:44.301+0000 16949700 -1 osd.4 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:21.035859+0000 front 2019-11-25T15:46:20.715871+0000 (oldest deadline 2019-11-25T15:47:06.599736+0000) 2019-11-25T15:47:44.327 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:47:44.323+0000 16949700 -1 osd.6 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.453539+0000 front 2019-11-25T15:46:24.856773+0000 (oldest deadline 2019-11-25T15:47:07.971381+0000) 2019-11-25T15:47:44.403 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:47:44.399+0000 16949700 -1 osd.2 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.490648+0000 front 2019-11-25T15:46:25.372263+0000 (oldest deadline 2019-11-25T15:47:06.437285+0000) 2019-11-25T15:47:44.706 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:47:44.701+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 43sec e197 v197) 2019-11-25T15:47:44.856 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:47:44.849+0000 16949700 -1 osd.1 197 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:46:25.947883+0000 front 2019-11-25T15:46:25.939024+0000 (oldest deadline 2019-11-25T15:47:07.625484+0000) 2019-11-25T15:48:24.846 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:23:37.993 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:24.869 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:23:38.017 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:24.870 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:23:38.018 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:24.873 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:23:38.124 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:24.874 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:23:38.022 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:24.878 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:23:38.129 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:25.110 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:23:38.258 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:25.123 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:23:38.271 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:25.190 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:23:38.441 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:29.100 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:29.078+0000 36a73700 -1 osd.5 202 build_incremental_map_msg missing incremental map 202 2019-11-25T15:48:29.307 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:29.257+0000 38a77700 -1 osd.5 202 build_incremental_map_msg missing incremental map 202 2019-11-25T15:48:29.364 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:29.290+0000 36272700 -1 osd.5 202 build_incremental_map_msg missing incremental map 202 2019-11-25T15:48:29.380 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:29.294+0000 35a71700 -1 osd.5 202 build_incremental_map_msg missing incremental map 202 2019-11-25T15:48:29.459 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:29.369+0000 36a73700 -1 osd.5 202 build_incremental_map_msg missing incremental map 202 2019-11-25T15:48:29.611 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:29.452+0000 36a73700 -1 osd.5 202 build_incremental_map_msg missing incremental map 202 2019-11-25T15:48:29.612 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:29.457+0000 36a73700 -1 osd.5 202 build_incremental_map_msg missing incremental map 202 2019-11-25T15:48:29.741 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:29.596+0000 38276700 -1 osd.5 202 build_incremental_map_msg missing incremental map 202 2019-11-25T15:48:29.788 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:29.597+0000 3b27c700 -1 osd.5 202 build_incremental_map_msg missing incremental map 202 2019-11-25T15:48:30.097 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:23:43.245 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:30.101 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:23:43.249 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:30.141 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:23:43.392 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:30.144 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:23:43.292 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:30.156 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:23:43.302 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:30.157 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:23:43.305 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:30.162 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:23:43.413 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:30.196 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:23:43.343 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:30.226 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:23:43.477 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:48:32.327 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:32.313+0000 38276700 -1 osd.5 203 build_incremental_map_msg missing incremental map 202 2019-11-25T15:48:41.287 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:41.254+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:42.175 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:42.171+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:42.378 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:42.375+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:43.150 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:43.146+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:43.194 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:43.190+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:43.430 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:43.426+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:43.509 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:43.507+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:43.631 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:43.628+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:44.136 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:44.132+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:44.212 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:44.209+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:44.453 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:44.451+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:44.557 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:44.554+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:44.673 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:44.670+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:44.931 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:44.926+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:45.117 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:45.112+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:45.200 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:45.197+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:45.476 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:45.473+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:45.566 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:45.563+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:45.687 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:45.684+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:45.933 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:45.927+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:46.075 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:46.070+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:46.244 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:46.242+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:46.515 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:46.512+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:46.610 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:46.607+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:46.721 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:46.718+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:46.960 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:46.956+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:47.060 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:47.056+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:47.285 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:47.282+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:47.511 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:47.509+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:47.607 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:47.602+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:47.698 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:47.696+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:48.004 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:47.999+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:48.095 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:48.090+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:48.282 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:48.279+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:48.486 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:48.484+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:48.609 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:48.607+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:48.729 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:48.726+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:49.056 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:49.052+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:49.075 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:49.071+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:49.278 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:49.276+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:49.500 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:49.498+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:49.588 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:49.586+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:49.695 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:49.692+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:50.071 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:50.067+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:50.100 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:50.096+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:50.239 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:50.236+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:50.510 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:50.507+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:50.624 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:50.621+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:50.746 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:50.744+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:51.093 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:51.089+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:51.106 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:51.102+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:51.245 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:51.243+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:51.553 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:51.550+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:51.641 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:51.639+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:51.747 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:51.744+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:52.054 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:52.050+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:52.092 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:52.089+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:52.214 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:52.210+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:52.548 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:52.545+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:52.672 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:52.670+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:52.751 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:52.748+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:53.086 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:53.082+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:53.095 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:53.092+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:53.246 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:53.239+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:53.589 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:53.586+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:53.706 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:53.702+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:53.734 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:53.731+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:54.082 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:54.078+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:54.127 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:54.123+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:54.206 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:54.203+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:54.559 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:54.556+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:54.733 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:54.730+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:54.781 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:54.778+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:55.129 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:55.126+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:55.178 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:55.174+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:55.228 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:55.225+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:55.585 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:55.582+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:55.708 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:55.704+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:55.833 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:55.830+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:56.103 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:56.098+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:56.142 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:56.138+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:56.190 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:56.187+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:56.558 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:56.555+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:56.699 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:56.696+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:56.797 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:56.795+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:57.101 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:57.098+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:57.184 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:57.181+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:57.220 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:57.217+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:57.599 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:57.595+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:57.753 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:57.751+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:57.771 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:57.767+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:58.089 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:58.086+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:58.197 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:58.193+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:58.216 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:58.213+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:58.633 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:58.631+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:58.744 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:58.742+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:58.800 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:58.797+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:59.093 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:48:59.090+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:48:59.215 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:48:59.212+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:48:59.217 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:48:59.214+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:48:59.622 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:48:59.620+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:48:59.762 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:48:59.759+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:48:59.833 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:48:59.829+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:48:59.913 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:48:59.910+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:00.115 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:00.111+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:00.204 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:00.201+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:00.270 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:00.267+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:00.623 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:00.620+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:00.771 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:00.768+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:00.812 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:00.806+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:00.918 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:00.915+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:01.141 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:01.138+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:01.173 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:01.170+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:01.278 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:01.274+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:01.665 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:01.662+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:01.764 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:01.758+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:01.806 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:01.802+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:01.941 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:01.934+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:02.137 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:02.133+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:02.140 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:02.138+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:02.305 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:02.301+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:02.687 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:02.685+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:02.797 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:02.794+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:02.798 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:02.795+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:02.925 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:02.922+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:03.105 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:03.102+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:03.120 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:03.116+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:03.298 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:03.295+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:03.702 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:03.699+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:03.805 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:03.802+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:03.821 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:03.817+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:03.930 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:03.926+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:04.082 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:04.078+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:04.102 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:04.099+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:04.265 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:04.261+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:04.698 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:04.695+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:04.812 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:04.810+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:04.842 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:04.840+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:04.983 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:04.978+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:05.127 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:05.124+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:05.140 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:05.135+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:05.251 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:05.246+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:05.747 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:05.745+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:05.800 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:05.797+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:05.852 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:05.849+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:06.026 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:06.021+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:06.027 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:06.023+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:06.168 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:06.165+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:06.175 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:06.170+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:06.238 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:06.232+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:06.716 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:06.712+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:06.767 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:06.764+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:06.822 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:06.819+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:07.076 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:07.068+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:07.076 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:07.072+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:07.145 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:07.142+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:07.165 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:07.160+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:07.261 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:07.254+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:07.690 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:07.688+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:07.786 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:07.782+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:07.827 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:07.823+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:08.129 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:08.124+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:08.130 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:08.126+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:08.161 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:08.159+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:08.181 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:08.176+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:08.291 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:08.287+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:08.738 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:08.735+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:08.770 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:08.768+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:08.792 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:08.790+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:09.161 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:09.158+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:09.178 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:09.173+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:09.179 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:09.175+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:09.233 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:09.228+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:09.303 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:09.298+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:09.764 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:09.762+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:09.788 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:09.785+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:09.812 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:09.809+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:10.140 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:10.136+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:10.174 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:10.168+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:10.175 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:10.171+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:10.269 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:10.265+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:10.302 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:10.298+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:10.768 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:10.765+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:10.782 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:10.779+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:10.852 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:10.850+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:11.103 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:11.101+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:11.134 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:11.127+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:11.134 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:11.130+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:11.281 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:11.276+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:11.319 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:11.314+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:11.786 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:11.784+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:11.787 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:11.785+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:11.904 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:11.901+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:12.084 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:12.080+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:12.155 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:12.150+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:12.157 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:12.154+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:12.296 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:12.292+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:12.319 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:12.314+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:12.782 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:12.779+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:12.836 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:12.833+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:12.885 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:12.883+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:13.111 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:13.109+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:13.155 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:13.150+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:13.155 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:13.152+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:13.325 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:13.320+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:13.330 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:13.324+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:13.797 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:13.793+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:13.814 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:13.810+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:13.912 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:13.908+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:14.123 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:14.118+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:14.201 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:14.196+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:14.202 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:14.198+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:14.322 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:14.317+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:14.329 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:14.326+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:14.809 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:14.805+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:14.852 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:14.848+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:14.960 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:14.956+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:15.135 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:15.131+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:15.214 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:49:15.211+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e204 v204) 2019-11-25T15:49:15.221 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:15.208+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:15.223 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:15.210+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:15.316 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:15.311+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:15.330 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:15.326+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:15.818 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:15.814+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:15.863 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:15.858+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:15.994 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:15.990+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:16.168 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:16.163+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:16.193 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:16.188+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:16.193 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:16.189+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:16.294 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:16.289+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:16.337 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:16.333+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:16.812 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:16.809+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:16.837 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:16.833+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:17.017 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:17.013+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:17.182 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:17.178+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:17.193 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:17.187+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:17.193 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:17.189+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:17.300 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:17.295+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:17.348 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:17.344+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:17.781 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:17.778+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:17.817 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:17.813+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:18.063 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:18.059+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:18.205 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:18.199+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:18.205 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:18.201+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:18.220 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:18.216+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:18.317 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:18.312+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:18.347 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:18.342+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:18.821 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:18.819+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:18.851 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:18.849+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:19.085 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:19.080+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:19.255 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:19.250+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:19.255 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:19.252+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:19.258 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:19.255+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:19.310 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:19.306+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:19.343 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:19.338+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:19.847 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:19.843+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:19.878 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:19.871+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:20.047 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:20.039+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:20.232 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:49:20.230+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e204 v204) 2019-11-25T15:49:20.238 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:20.235+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:20.301 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:20.292+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:20.302 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:20.294+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:20.305 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:20.294+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:20.324 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:20.320+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:20.891 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:20.887+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:20.916 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:20.913+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:21.008 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:21.005+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:21.220 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:21.217+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:21.255 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:21.251+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:21.258 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:21.255+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:21.263 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:21.258+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:21.283 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:21.279+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:21.935 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:21.931+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:21.936 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:21.933+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:22.010 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:22.007+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:22.226 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:22.223+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:22.247 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:22.243+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:22.249 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:22.246+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:22.259 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:22.254+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:22.309 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:22.304+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:22.933 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:22.926+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:22.972 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:22.967+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:22.986 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:22.983+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:23.219 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:23.216+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:23.270 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:23.265+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:23.273 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:23.269+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:23.303 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:23.299+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:23.347 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:23.343+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:23.944 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:23.942+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:23.975 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:23.972+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:24.039 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:24.034+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:24.182 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:24.179+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:24.256 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:24.252+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:24.259 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:24.256+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:24.265 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:24.261+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:24.350 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:24.345+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:24.921 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:24.918+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:25.030 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:25.028+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:25.033 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:25.028+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:25.147 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:25.145+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:25.255 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:49:25.252+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e204 v204) 2019-11-25T15:49:25.289 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:25.283+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:25.306 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:25.303+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:25.308 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:25.305+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:25.315 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:25.311+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:25.882 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:25.879+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:25.988 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:25.986+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:25.995 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:25.994+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:26.172 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:26.170+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:26.330 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:26.325+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:26.356 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:26.351+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:26.356 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:26.351+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:26.360 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:26.357+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:26.866 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:26.864+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:27.017 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:27.014+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:27.042 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:27.039+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:27.161 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:27.159+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:27.322 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:27.317+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:27.350 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:27.345+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:27.380 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:27.376+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:27.383 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:27.380+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:27.881 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:27.877+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:28.011 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:28.008+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:28.070 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:28.066+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:28.191 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:28.188+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:28.318 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:28.314+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:28.356 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:28.351+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:28.357 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:28.353+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:28.380 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:28.375+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:28.915 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:28.912+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:28.999 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:28.996+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:29.041 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:29.038+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:29.242 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:29.239+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:29.321 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:29.317+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:29.373 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:29.368+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:29.374 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:29.370+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:29.382 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:29.377+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:29.906 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:29.902+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:29.978 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:29.975+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:30.016 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:30.013+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:30.240 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:30.237+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:30.268 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:49:30.264+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e204 v204) 2019-11-25T15:49:30.337 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:30.333+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:30.338 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:30.334+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:30.347 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:30.342+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:30.388 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:30.383+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:30.871 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:30.868+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:30.960 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:30.958+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:31.020 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:31.017+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:31.288 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:31.285+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:31.296 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:31.291+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:31.297 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:31.293+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:31.374 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:31.369+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:31.382 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:31.377+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:31.907 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:31.903+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:31.980 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:31.977+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:32.062 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:32.060+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:32.250 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:32.247+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:32.348 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:32.344+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:32.349 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:32.345+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:32.377 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:32.373+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:32.391 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:32.387+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:32.914 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:32.913+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:33.000 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:32.998+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:33.050 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:33.047+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:33.216 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:33.213+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:33.310 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:33.304+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:33.310 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:33.306+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:33.382 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:33.378+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:33.409 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:33.405+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:33.939 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:33.936+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:34.042 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:34.038+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:34.076 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:34.074+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:34.234 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:34.232+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:34.343 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:34.339+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:34.344 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:34.340+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:34.411 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:34.407+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:34.434 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:34.431+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:34.942 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:34.939+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:35.040 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:35.037+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:35.129 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:35.127+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:35.236 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:35.233+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:35.291 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:49:35.288+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e204 v204) 2019-11-25T15:49:35.355 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:35.351+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:35.356 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:35.352+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:35.432 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:35.428+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:35.464 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:35.459+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:35.949 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:35.945+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:36.054 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:36.051+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:36.090 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:36.088+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:36.219 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:36.216+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:36.403 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:36.398+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:36.403 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:36.399+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:36.440 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:36.435+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:36.461 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:36.458+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:36.957 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:36.953+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:37.062 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:37.060+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:37.130 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:37.126+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:37.240 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:37.233+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:37.405 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:37.399+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:37.406 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:37.401+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:37.408 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:37.403+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:37.447 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:37.443+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:37.999 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:37.997+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:38.077 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:38.074+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:38.181 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:38.177+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:38.208 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:38.205+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:38.391 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:38.387+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:38.396 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:38.392+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:38.399 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:38.395+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:38.453 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:38.449+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:38.959 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:38.954+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:39.058 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:39.055+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:39.225 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:39.223+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:39.228 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:39.224+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:39.394 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:39.389+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:39.395 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:39.390+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:39.409 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:39.405+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:39.424 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:39.419+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:49:39.992 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:49:39.988+0000 16949700 -1 osd.3 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.346406+0000 front 2019-11-25T15:47:55.368035+0000 (oldest deadline 2019-11-25T15:48:41.241335+0000) 2019-11-25T15:49:40.063 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:49:40.060+0000 16949700 -1 osd.2 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.333605+0000 front 2019-11-25T15:48:00.335086+0000 (oldest deadline 2019-11-25T15:48:43.114024+0000) 2019-11-25T15:49:40.212 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:49:40.209+0000 16949700 -1 osd.1 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:00.312102+0000 front 2019-11-25T15:48:00.322275+0000 (oldest deadline 2019-11-25T15:48:42.896133+0000) 2019-11-25T15:49:40.223 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:49:40.219+0000 16949700 -1 osd.0 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:58.966166+0000 front 2019-11-25T15:47:58.457926+0000 (oldest deadline 2019-11-25T15:48:42.582103+0000) 2019-11-25T15:49:40.379 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:49:40.366+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e204 v204) 2019-11-25T15:49:40.408 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:40.403+0000 16949700 -1 osd.5 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:48:25.512109+0000 (oldest deadline 2019-11-25T15:49:05.512109+0000) 2019-11-25T15:49:40.409 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:49:40.404+0000 16949700 -1 osd.6 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:47:59.685910+0000 front 2019-11-25T15:47:59.415979+0000 (oldest deadline 2019-11-25T15:48:44.604733+0000) 2019-11-25T15:49:40.409 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:49:40.404+0000 16949700 -1 osd.5 204 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e201) 2019-11-25T15:49:40.461 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:49:40.457+0000 16949700 -1 osd.7 204 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:48:01.259577+0000 front 2019-11-25T15:48:00.941531+0000 (oldest deadline 2019-11-25T15:48:41.229811+0000) 2019-11-25T15:50:30.678 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:25:43.826 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:50:30.698 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:25:43.846 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:50:30.727 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:25:43.875 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:50:30.743 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:25:43.891 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:50:30.750 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:25:44.001 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:50:30.753 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:25:44.004 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:50:30.861 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:25:44.009 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:50:30.911 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:25:44.059 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:50:30.920 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:25:44.171 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:50:36.056 INFO:teuthology.orchestra.run.smithi135.stderr:testMetadataOnPut (test.functional.tests.TestFile) ... ok 2019-11-25T15:50:59.839 INFO:teuthology.orchestra.run.smithi135.stderr:testNameLimit (test.functional.tests.TestFile) ... ok 2019-11-25T15:50:59.886 INFO:teuthology.orchestra.run.smithi135.stderr:testNoContentLengthForPut (test.functional.tests.TestFile) ... ok 2019-11-25T15:51:00.621 INFO:teuthology.orchestra.run.smithi135.stderr:testPostOnFileThatDoesNotExist (test.functional.tests.TestFile) ... ok 2019-11-25T15:51:13.926 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:13.921+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:14.195 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:14.192+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:14.571 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:14.565+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:14.968 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:14.962+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:15.164 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:15.160+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:15.228 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:15.225+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:15.508 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:15.505+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:15.551 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:15.548+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:16.015 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:16.010+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:16.186 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:16.184+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:16.206 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:16.204+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:16.472 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:16.469+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:16.544 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:16.540+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:16.555 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:16.552+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:16.989 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:16.985+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:17.175 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:17.173+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:17.256 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:17.248+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:17.467 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:17.465+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:17.570 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:17.567+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:17.607 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:17.603+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:18.024 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:18.018+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:18.036 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:18.032+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:18.191 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:18.188+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:18.261 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:18.258+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:18.434 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:18.431+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:18.621 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:18.619+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:18.637 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:18.633+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:19.081 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:19.065+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:19.081 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:19.073+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:19.234 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:19.231+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:19.239 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:19.237+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:19.438 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:19.434+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:19.604 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:19.602+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:19.699 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:19.668+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:20.040 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:20.036+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:20.100 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:20.095+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:20.195 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:20.193+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:20.260 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:20.258+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:20.481 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:20.478+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:20.616 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:20.613+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:20.716 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:20.713+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:21.074 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:21.061+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:21.088 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:21.083+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:21.263 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:21.246+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:21.305 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:21.303+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:21.506 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:21.503+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:21.669 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:21.666+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:21.716 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:21.712+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:22.040 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:22.035+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:22.100 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:22.095+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:22.247 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:22.244+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:22.324 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:22.321+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:22.531 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:22.528+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:22.632 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:22.628+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:22.724 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:22.720+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:23.005 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:23.000+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:23.094 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:23.089+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:23.240 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:23.237+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:23.314 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:23.312+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:23.507 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:23.505+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:23.669 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:23.666+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:23.770 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:23.765+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:24.058 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:24.053+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:24.128 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:24.124+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:24.227 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:24.224+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:24.301 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:24.299+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:24.501 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:24.498+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:24.679 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:24.676+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:24.725 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:24.721+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:25.036 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:25.031+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:25.119 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:25.115+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:25.278 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:25.275+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:25.328 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:25.326+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:25.542 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:25.540+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:25.670 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:25.668+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:25.708 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:25.703+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:26.070 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:26.065+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:26.086 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:26.081+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:26.307 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:26.304+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:26.334 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:26.331+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:26.590 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:26.588+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:26.651 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:26.648+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:26.755 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:26.731+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:27.025 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:27.021+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:27.084 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:27.079+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:27.277 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:27.275+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:27.468 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:27.399+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:27.547 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:27.545+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:27.701 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:27.699+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:27.717 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:27.712+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:28.065 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:28.061+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:28.105 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:28.099+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:28.301 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:28.298+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:28.373 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:28.370+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:28.603 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:28.600+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:28.709 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:28.705+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:28.709 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:28.707+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:29.111 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:29.106+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:29.120 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:29.115+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:29.279 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:29.275+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:29.424 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:29.421+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:29.614 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:29.611+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:29.698 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:29.695+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:29.722 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:29.718+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:30.136 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:30.132+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:30.163 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:30.158+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:30.319 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:30.315+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:30.564 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:30.558+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:30.581 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:30.578+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:30.734 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:30.730+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:30.747 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:30.742+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:31.145 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:31.141+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:31.241 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:31.235+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:31.276 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:31.272+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:31.580 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:31.576+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:31.603 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:31.600+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:31.704 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:31.699+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:31.740 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:31.737+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:32.152 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:32.148+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:32.225 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:32.220+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:32.306 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:32.302+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:32.606 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:32.601+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:32.698 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:32.692+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:32.718 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:32.715+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:32.785 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:32.775+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:33.109 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:33.104+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:33.214 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:33.210+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:33.324 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:33.319+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:33.575 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:33.571+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:33.698 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:33.693+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:33.752 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:33.742+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:33.824 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:33.820+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:34.063 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:34.059+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:34.238 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:34.233+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:34.365 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:34.362+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:34.538 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:34.535+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:34.749 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:34.745+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:34.847 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:34.843+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:34.906 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:34.876+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:35.088 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:35.084+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:35.243 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:35.238+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:35.341 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:35.337+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:35.579 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:35.561+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:35.709 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:35.706+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:35.878 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:35.875+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:35.889 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:35.885+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:36.055 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:36.050+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:36.243 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:36.237+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:36.364 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:36.361+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:36.558 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:36.550+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:36.736 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:36.733+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:36.854 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:36.849+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:36.931 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:36.928+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:37.023 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:37.019+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:37.302 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:37.297+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:37.358 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:37.354+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:37.599 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:37.573+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:37.692 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:37.690+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:37.895 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:37.892+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:37.985 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:37.981+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:38.082 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:38.079+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:38.353 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:38.350+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:38.382 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:38.379+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:38.621 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:38.618+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:38.676 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:38.673+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:38.872 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:38.869+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:38.974 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:38.969+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:39.062 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:39.056+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:39.316 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:39.312+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:39.335 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:39.331+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:39.584 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:39.582+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:39.706 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:39.703+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:39.893 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:39.890+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:39.955 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:39.951+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:40.086 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:40.082+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:40.285 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:40.281+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:40.357 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:40.353+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:40.590 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:40.587+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:40.717 INFO:teuthology.orchestra.run.smithi135.stderr:testRangedGets (test.functional.tests.TestFile) ... ok 2019-11-25T15:51:40.759 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:40.756+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:40.900 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:40.897+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:40.998 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:40.994+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:41.123 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:41.119+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:41.251 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:41.249+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:41.436 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:41.412+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:41.579 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:41.576+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:41.805 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:41.802+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:41.886 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:41.884+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:42.048 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:42.045+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:42.179 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:42.174+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:42.244 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:42.241+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:42.497 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:42.493+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:42.633 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:42.629+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:42.774 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:42.772+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:42.914 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:42.911+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:43.084 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:43.080+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:43.213 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:43.208+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:43.237 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:43.228+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:43.501 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:43.496+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:43.641 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:43.637+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:43.731 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:43.727+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:43.941 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:43.937+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:44.108 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:44.104+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:44.213 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:44.208+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:44.264 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:44.261+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:44.493 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:44.489+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:44.623 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:44.620+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:44.778 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:44.773+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:44.948 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:44.945+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:45.117 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:45.112+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:45.236 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:45.234+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:45.250 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:45.245+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:45.486 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:45.482+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:45.593 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:45.589+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:45.831 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:45.828+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:45.881 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:51:45.877+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 42sec e209 v209) 2019-11-25T15:51:45.964 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:45.961+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:46.142 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:46.138+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:46.251 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:46.247+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:46.281 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:46.278+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:46.508 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:46.504+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:46.551 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:46.548+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:46.836 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:46.834+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:46.951 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:46.948+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:47.157 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:47.153+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:47.216 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:47.212+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:47.245 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:47.242+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:47.586 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:47.584+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:47.831 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:47.827+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:47.932 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:47.930+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:47.958 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:47.945+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:48.173 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:48.168+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:48.179 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:48.175+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:48.293 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:48.291+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:48.641 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:48.638+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:48.866 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:48.863+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:48.945 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:48.941+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:48.999 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:48.994+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:49.165 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:49.161+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:49.221 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:49.216+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:49.255 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:49.253+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:49.640 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:49.638+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:49.849 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:49.847+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:49.908 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:49.906+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:50.000 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:49.995+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:51:50.171 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:51:50.166+0000 16949700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.146589+0000 front 2019-11-25T15:50:34.666277+0000 (oldest deadline 2019-11-25T15:51:17.525577+0000) 2019-11-25T15:51:50.207 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:51:50.203+0000 16949700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.944281+0000 front 2019-11-25T15:50:32.059267+0000 (oldest deadline 2019-11-25T15:51:13.910083+0000) 2019-11-25T15:51:50.224 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:51:50.221+0000 16949700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:30.549380+0000 front 2019-11-25T15:50:29.652660+0000 (oldest deadline 2019-11-25T15:51:14.217522+0000) 2019-11-25T15:51:50.596 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:51:50.594+0000 16949700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:33.063461+0000 front 2019-11-25T15:50:34.661191+0000 (oldest deadline 2019-11-25T15:51:14.189069+0000) 2019-11-25T15:51:50.829 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:51:50.826+0000 16949700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.144021+0000 front 2019-11-25T15:50:32.141621+0000 (oldest deadline 2019-11-25T15:51:14.553556+0000) 2019-11-25T15:51:50.866 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:51:50.863+0000 16949700 -1 osd.1 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.046043+0000 front 2019-11-25T15:50:32.072160+0000 (oldest deadline 2019-11-25T15:51:15.486627+0000) 2019-11-25T15:51:50.958 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:51:50.955+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 42sec e209 v209) 2019-11-25T15:51:51.051 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:51:51.046+0000 16949700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:50:32.041112+0000 front 2019-11-25T15:50:32.025577+0000 (oldest deadline 2019-11-25T15:51:13.169214+0000) 2019-11-25T15:52:15.712 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:27:28.859 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:52:15.719 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:27:28.866 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:52:15.726 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:27:28.976 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:52:15.727 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:27:28.875 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:52:15.728 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:27:28.979 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:52:15.730 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:27:28.878 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:52:15.822 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:27:28.968 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:52:15.833 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:27:28.981 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:52:15.845 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:27:29.096 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:52:48.219 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:48.216+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:48.990 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:48.985+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:49.219 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:49.216+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:50.020 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:50.015+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:50.255 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:50.251+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:50.403 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:50.400+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:52:51.047 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:51.041+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:51.065 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:51.058+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:52:51.257 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:51.255+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:51.266 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:52:51.263+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:52:51.379 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:51.376+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:52:51.380 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:51.378+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:52:51.637 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:52:51.631+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:52:51.951 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:52:51.947+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:52:52.022 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:52.017+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:52.023 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:52.019+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:52:52.243 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:52.241+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:52.251 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:52:52.248+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:52:52.390 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:52.388+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:52:52.390 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:52.388+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:52:52.640 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:52:52.635+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:52:52.942 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:52:52.939+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:52:52.980 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:52.975+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:52.981 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:52.976+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:52:53.222 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:53.219+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:53.227 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:52:53.224+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:52:53.429 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:53.425+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:52:53.432 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:53.431+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:52:53.686 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:52:53.682+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:52:53.941 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:52:53.937+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:52:54.027 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:54.022+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:54.028 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:54.024+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:52:54.206 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:54.204+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:54.265 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:52:54.262+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:52:54.456 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:54.453+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:52:54.456 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:54.454+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:52:54.670 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:52:54.665+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:52:54.949 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:52:54.946+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:52:55.025 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:55.020+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:55.026 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:55.022+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:52:55.257 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:52:55.253+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:52:55.259 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:55.256+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:55.488 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:55.486+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:52:55.489 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:55.488+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:52:55.665 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:52:55.661+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:52:55.970 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:52:55.967+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:52:56.002 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:55.997+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:56.003 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:55.999+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:52:56.232 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:56.229+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:56.314 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:52:56.310+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:52:56.467 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:56.464+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:52:56.479 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:56.466+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:52:56.681 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:52:56.676+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:52:56.986 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:52:56.984+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:52:57.022 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:57.016+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:57.022 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:57.018+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:52:57.247 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:57.244+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:57.316 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:52:57.313+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:52:57.433 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:57.430+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:52:57.434 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:57.432+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:52:57.707 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:52:57.702+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:52:58.018 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:52:58.015+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:52:58.039 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:58.034+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:58.039 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:58.036+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:52:58.261 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:58.258+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:58.296 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:52:58.293+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:52:58.392 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:58.389+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:52:58.394 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:58.393+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:52:58.722 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:52:58.718+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:52:58.994 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:58.989+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:58.996 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:58.993+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:52:59.035 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:52:59.033+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:52:59.296 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:52:59.294+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:52:59.309 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:52:59.306+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:52:59.350 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:59.347+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:52:59.350 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:52:59.349+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:52:59.739 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:52:59.734+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:52:59.976 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:59.972+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:52:59.979 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:52:59.976+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:00.066 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:00.062+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:00.259 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:00.254+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:00.318 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:00.315+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:00.380 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:00.375+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:00.381 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:00.377+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:00.770 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:00.765+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:01.000 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:00.994+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:01.000 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:00.995+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:01.113 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:01.108+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:01.279 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:01.276+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:01.306 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:01.301+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:01.433 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:01.428+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:01.433 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:01.430+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:01.764 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:01.759+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:01.982 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:01.977+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:01.983 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:01.978+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:02.085 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:02.081+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:02.262 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:02.257+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:02.267 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:02.262+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:02.490 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:02.476+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:02.490 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:02.478+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:02.763 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:02.759+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:03.006 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:03.002+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:03.006 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:03.002+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:03.135 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:03.130+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:03.237 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:03.232+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:03.282 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:03.278+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:03.501 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:03.496+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:03.501 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:03.498+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:03.734 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:03.730+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:04.035 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:04.029+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:04.035 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:04.031+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:04.125 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:04.121+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:04.229 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:04.225+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:04.317 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:04.314+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:04.506 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:04.504+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:04.509 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:04.507+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:04.758 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:04.754+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:04.773 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:04.769+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:05.079 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:05.074+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:05.084 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:05.080+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:05.160 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:05.159+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:05.184 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:05.182+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:05.337 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:05.334+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:05.542 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:05.539+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:05.543 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:05.541+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:05.805 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:05.801+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:05.825 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:05.822+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:06.083 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:06.078+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:06.086 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:06.082+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:06.146 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:06.143+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:06.164 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:06.161+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:06.361 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:06.356+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:06.559 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:06.556+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:06.561 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:06.560+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:06.810 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:06.805+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:06.840 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:06.835+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:07.072 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:07.067+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:07.072 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:07.069+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:07.137 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:07.134+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:07.201 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:07.198+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:07.394 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:07.391+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:07.553 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:07.550+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:07.555 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:07.553+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:07.794 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:07.790+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:07.795 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:07.790+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:08.060 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:08.057+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:08.062 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:08.060+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:08.123 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:08.119+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:08.245 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:08.242+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:08.404 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:08.401+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:08.565 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:08.562+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:08.566 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:08.564+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:08.775 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:08.773+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:08.810 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:08.806+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:09.055 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:09.050+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:09.055 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:09.052+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:09.086 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:09.082+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:09.249 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:09.245+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:09.445 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:09.443+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:09.595 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:09.592+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:09.598 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:09.596+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:09.799 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:09.795+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:09.799 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:09.796+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:09.845 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:09.841+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:10.103 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:10.099+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:10.104 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:10.101+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:10.130 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:10.127+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:10.259 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:10.256+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:10.425 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:10.422+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:10.633 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:10.628+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:10.633 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:10.630+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:10.798 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:10.794+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:10.801 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:10.798+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:10.874 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:10.870+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:11.156 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:11.152+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:11.157 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:11.155+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:11.161 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:11.158+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:11.308 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:11.297+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:11.477 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:11.474+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:11.646 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:11.643+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:11.646 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:11.644+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:11.805 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:11.801+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:11.806 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:11.803+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:11.838 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:11.835+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:12.180 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:12.176+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:12.181 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:12.178+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:12.186 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:12.184+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:12.337 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:12.334+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:12.522 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:12.519+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:12.667 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:12.665+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:12.669 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:12.668+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:12.791 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:12.787+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:12.793 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:12.789+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:12.874 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:12.870+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:13.230 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:13.226+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:13.233 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:13.228+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:13.233 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:13.230+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:13.358 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:13.355+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:13.553 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:13.549+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:13.658 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:13.654+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:13.659 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:13.656+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:13.808 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:13.805+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:13.809 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:13.806+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:13.865 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:13.862+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:14.208 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:14.205+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:14.222 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:14.219+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:14.225 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:14.222+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:14.380 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:14.376+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:14.558 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:14.554+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:14.620 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:14.618+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:14.623 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:14.622+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:14.814 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:14.810+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:14.815 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:14.811+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:14.914 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:14.909+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:15.216 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:15.212+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:15.217 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:15.213+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:15.217 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:15.215+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:15.371 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:15.367+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:15.544 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:15.541+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:15.647 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:15.645+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:15.648 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:15.646+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:15.861 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:15.856+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:15.861 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:15.858+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:15.882 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:15.878+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:16.173 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:16.170+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:16.176 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:16.173+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:16.180 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:16.176+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:16.374 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:16.370+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:16.559 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:16.556+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:16.622 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:16.619+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:16.624 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:16.623+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:16.854 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:16.850+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:16.862 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:16.857+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:16.863 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:16.860+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:17.172 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:17.168+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:17.172 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:17.169+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:17.198 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:17.194+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:17.347 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:17.344+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:17.555 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:17.553+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:17.668 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:17.666+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:17.671 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:17.669+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:17.860 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:17.855+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:17.860 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:17.857+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:17.896 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:17.893+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:18.209 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:18.205+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:18.209 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:18.206+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:18.245 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:18.241+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:18.329 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:18.326+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:18.540 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:18.531+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:18.704 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:18.702+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:18.705 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:18.704+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:18.833 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:18.829+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:18.836 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:18.833+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:18.927 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:18.924+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:19.229 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:19.224+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:19.229 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:19.226+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:19.233 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:19.230+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:19.326 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:19.323+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:19.541 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:19.538+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:19.690 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:19.687+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:19.690 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:19.688+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:19.801 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:19.797+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:19.802 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:19.799+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:19.882 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:19.879+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:20.199 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:20.197+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:20.213 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:20.210+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:20.216 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:20.213+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:20.297 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:20.293+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:20.582 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:20.579+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:20.650 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:20.648+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:20.651 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:20.649+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:20.791 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:20.788+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:20.795 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:20.792+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:20.922 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:20.918+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:21.161 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:21.158+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:21.238 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:21.234+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:21.239 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:21.236+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:21.300 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:21.298+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:21.362 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:53:21.360+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 3 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 45sec e216 v216) 2019-11-25T15:53:21.604 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:21.600+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:21.675 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:21.673+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:21.676 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:21.675+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:21.776 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:21.773+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:21.777 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:21.774+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:21.909 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:21.904+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:22.160 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:22.157+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:22.233 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:22.230+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:22.234 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:22.231+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:22.279 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:22.276+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:22.566 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:22.562+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:22.702 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:22.700+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:22.704 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:22.703+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:22.824 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:22.818+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:22.824 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:22.820+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:22.931 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:22.927+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:23.164 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:23.162+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:23.220 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:23.214+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:23.220 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:23.216+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:23.235 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:23.232+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:23.547 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:23.544+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:23.711 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:23.709+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:23.712 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:23.710+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:23.814 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:23.811+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:23.817 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:23.813+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:23.895 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:23.890+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:24.165 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:24.161+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:24.250 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:24.245+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:24.251 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:24.247+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:24.280 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:24.277+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:24.562 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:24.558+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:24.744 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:24.741+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:24.746 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:24.744+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:24.861 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:24.856+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:24.862 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:24.858+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:24.920 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:24.915+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:25.158 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:25.155+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:25.215 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:25.210+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:25.216 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:25.212+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:25.314 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:25.311+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:25.561 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:25.550+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:25.794 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:25.790+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:25.796 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:25.794+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:25.866 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:25.862+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:25.870 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:25.866+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:25.904 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:25.899+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:26.150 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:26.147+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:26.192 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:26.186+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:26.193 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:26.188+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:26.337 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:26.334+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:26.381 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:53:26.378+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 45sec e216 v216) 2019-11-25T15:53:26.600 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:26.597+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:26.833 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:26.828+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:26.835 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:26.830+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:26.856 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:26.851+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:26.856 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:26.853+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:26.932 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:26.928+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:27.130 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:27.127+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:27.156 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:27.150+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:27.156 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:27.152+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:27.300 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:27.296+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:27.581 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:27.578+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:27.843 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:27.840+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:27.844 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:27.842+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:27.910 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:27.905+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:27.911 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:27.907+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:27.968 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:27.963+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:28.169 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:28.165+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:28.170 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:28.165+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:28.171 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:28.167+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:28.301 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:28.298+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:28.553 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:28.549+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:28.885 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:28.882+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:28.885 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:28.883+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:28.894 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:28.889+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:28.895 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:28.891+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:29.017 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:29.011+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:29.123 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:29.119+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:29.214 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:29.210+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:29.216 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:29.213+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:29.325 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:29.322+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:29.579 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:29.574+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:29.885 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:29.883+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:29.886 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:29.885+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:29.906 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:29.901+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:29.908 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:29.903+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:30.024 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:30.020+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:30.092 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:30.089+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:30.187 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:30.182+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:30.190 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:30.186+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:30.353 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:30.350+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:30.596 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:30.593+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:30.856 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:30.852+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:30.856 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:30.854+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:30.928 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:30.921+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:30.928 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:30.924+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:31.069 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:31.064+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:31.088 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:31.084+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:31.211 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:31.206+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:31.211 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:31.208+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:31.326 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:31.323+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:31.404 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:53:31.397+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 45sec e216 v216) 2019-11-25T15:53:31.609 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:31.606+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:31.889 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:31.885+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:31.889 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:31.887+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:31.979 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:31.974+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:31.980 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:31.975+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:32.053 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:32.048+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:32.100 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:32.097+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:32.239 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:32.234+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:32.239 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:32.235+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:32.299 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:32.295+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:32.605 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:32.601+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:32.882 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:32.879+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:32.885 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:32.883+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:33.014 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:33.009+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:33.014 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:33.010+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:33.053 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:33.049+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:33.123 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:33.119+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:33.237 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:33.231+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:33.237 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:33.232+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:33.335 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:33.320+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:33.642 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:33.639+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:33.918 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:33.915+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:33.920 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:33.918+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:33.992 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:33.988+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:33.993 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:33.989+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:34.029 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:34.025+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:34.134 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:34.130+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:34.192 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:34.186+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:34.192 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:34.188+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:34.324 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:34.321+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:34.611 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:34.608+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:34.906 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:34.902+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:34.906 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:34.904+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:34.980 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:34.976+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:34.983 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:34.980+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:35.019 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:35.015+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:35.155 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:35.152+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:35.196 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:35.190+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:35.197 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:35.193+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:35.317 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:35.314+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:35.638 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:35.636+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:35.955 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:35.953+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:35.958 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:35.956+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:35.986 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:35.981+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:36.000 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:35.995+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:36.001 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:35.997+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:36.184 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:36.181+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:36.227 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:36.223+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:36.230 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:36.227+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:36.342 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:36.339+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:36.423 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:53:36.420+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 45sec e216 v216) 2019-11-25T15:53:36.636 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:36.633+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:36.932 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:36.928+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:36.933 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:36.931+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:36.973 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:36.968+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:36.979 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:36.973+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:36.983 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:36.975+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:37.210 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:37.207+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:37.267 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:37.263+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:37.270 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:37.266+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:37.358 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:37.355+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:37.689 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:37.685+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:37.932 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:37.928+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:37.935 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:37.932+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:38.000 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:37.996+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:38.006 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:38.002+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:38.007 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:38.003+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:38.214 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:38.210+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:38.250 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:38.246+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:38.254 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:38.250+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:38.335 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:38.332+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:38.692 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:38.689+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:38.931 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:38.928+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:38.934 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:38.932+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:38.969 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:38.965+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:39.037 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:39.032+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:39.037 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:39.034+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:39.235 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:39.232+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:39.251 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:39.245+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:39.251 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:39.247+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:39.297 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:39.295+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:39.681 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:39.679+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:39.916 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:39.912+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:39.916 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:39.914+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:39.926 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:39.921+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:40.074 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:40.069+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:40.077 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:40.073+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:40.269 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:40.266+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:40.284 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:40.278+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:40.287 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:40.284+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:40.307 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:40.304+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:40.690 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:40.687+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:40.892 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:40.888+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:40.958 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:40.955+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:40.959 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:40.957+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:41.089 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:41.085+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:41.091 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:41.088+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:41.246 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:41.244+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:41.286 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:41.282+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:41.292 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:41.288+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:41.295 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:41.292+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:41.440 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:53:41.436+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 45sec e216 v216) 2019-11-25T15:53:41.656 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:41.653+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:41.917 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:41.912+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:41.950 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:41.947+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:41.953 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:41.951+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:42.132 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:42.128+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:42.135 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:42.131+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:42.254 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:42.250+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:42.286 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:42.282+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:42.295 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:42.290+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:42.298 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:42.294+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:42.614 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:42.611+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:42.951 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:42.946+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:42.989 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:42.985+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:42.989 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:42.987+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:43.121 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:43.113+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:43.124 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:43.115+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:43.212 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:43.209+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:43.287 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:43.282+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:43.287 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:43.283+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:43.287 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:53:43.283+0000 16949700 -1 osd.1 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:07.365180+0000 front 2019-11-25T15:52:07.413581+0000 (oldest deadline 2019-11-25T15:52:50.463830+0000) 2019-11-25T15:53:43.587 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:43.585+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:43.999 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:43.995+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:44.004 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:44.000+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:44.004 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:44.002+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:44.093 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:44.089+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:44.096 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:44.093+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:44.168 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:44.164+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:44.332 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:44.327+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:44.335 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:44.331+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:44.593 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:44.588+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:44.997 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:44.992+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:44.997 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:44.994+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:44.999 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:44.994+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:45.068 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:45.063+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:45.069 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:45.065+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:45.177 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:45.173+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:45.367 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:45.362+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:45.368 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:45.363+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:45.643 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:53:45.639+0000 16949700 -1 osd.0 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.360729+0000 front 2019-11-25T15:52:08.251029+0000 (oldest deadline 2019-11-25T15:52:47.488229+0000) 2019-11-25T15:53:46.005 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:53:46.001+0000 16949700 -1 osd.6 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:04.263967+0000 front 2019-11-25T15:52:03.742648+0000 (oldest deadline 2019-11-25T15:52:51.578986+0000) 2019-11-25T15:53:46.035 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:46.030+0000 16949700 -1 osd.3 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.719602+0000 front 2019-11-25T15:52:05.712288+0000 (oldest deadline 2019-11-25T15:52:50.003089+0000) 2019-11-25T15:53:46.036 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:46.032+0000 16949700 -1 osd.3 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:46.109 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:46.104+0000 16949700 -1 osd.5 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:52:29.329139+0000 (oldest deadline 2019-11-25T15:53:09.329139+0000) 2019-11-25T15:53:46.110 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:53:46.106+0000 16949700 -1 osd.5 216 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e215) 2019-11-25T15:53:46.149 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:53:46.144+0000 16949700 -1 osd.2 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:05.738385+0000 front 2019-11-25T15:52:05.492190+0000 (oldest deadline 2019-11-25T15:52:51.365664+0000) 2019-11-25T15:53:46.353 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:46.349+0000 16949700 -1 osd.7 216 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:52:02.618989+0000 front 2019-11-25T15:52:02.789031+0000 (oldest deadline 2019-11-25T15:52:48.445750+0000) 2019-11-25T15:53:46.355 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:53:46.351+0000 16949700 -1 osd.7 216 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111450 2.1s0 2.c1b20681 (undecoded) ondisk+write+known_if_redirected e211) 2019-11-25T15:53:46.524 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:53:46.516+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 45sec e216 v216) 2019-11-25T15:53:47.598 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:47.449+0000 16949700 -1 osd.3 217 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:48.590 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:48.583+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:49.667 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:49.664+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:50.626 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:50.624+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:51.594 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:51.592+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:52.562 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:52.560+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:53.582 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:53.580+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:54.617 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:54.615+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:55.598 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:55.592+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:56.606 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:56.604+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:57.586 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:57.584+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:58.582 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:58.580+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:53:59.590 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:53:59.588+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:54:00.554 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:54:00.552+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:54:01.587 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:54:01.585+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:54:02.594 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:54:02.592+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:54:03.638 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:54:03.636+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:54:04.617 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:54:04.615+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:54:05.649 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:54:05.647+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:54:06.636 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:54:06.634+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:54:07.625 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:54:07.623+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:54:08.630 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:54:08.621+0000 16949700 -1 osd.3 218 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111451 5.e 5:7759931f:::notify.3:head [watch reconnect cookie 821589216 gen 62] snapc 0=[] ondisk+write+known_if_redirected e211) 2019-11-25T15:55:04.390 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:04.386+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:05.438 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:05.434+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:06.483 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:06.478+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:07.454 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:07.451+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:08.496 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:08.492+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:09.503 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:09.499+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:10.542 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:10.538+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:11.511 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:11.507+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:12.481 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:12.477+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:13.437 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:13.432+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:14.472 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:14.467+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:15.499 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:15.495+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:16.542 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:16.538+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:17.579 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:17.576+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:18.016 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:18.013+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:18.492 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:18.488+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:18.538 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:18.534+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:18.990 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:18.988+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:19.472 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:19.469+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:19.506 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:19.502+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:19.507 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:19.504+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:19.703 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:19.700+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:20.036 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:20.033+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:20.442 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:20.437+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:20.460 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:20.458+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:20.518 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:20.515+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:20.520 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:20.518+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:20.747 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:20.742+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:21.084 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:21.081+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:21.119 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:21.115+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:21.433 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:21.430+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:21.459 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:21.455+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:21.516 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:21.513+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:21.516 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:21.514+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:21.789 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:21.787+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:22.050 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:22.048+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:22.087 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:22.084+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:22.444 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:22.440+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:22.477 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:22.473+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:22.501 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:22.498+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:22.504 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:22.501+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:22.765 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:22.763+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:23.059 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:23.056+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:23.093 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:23.090+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:23.475 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:23.472+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:23.476 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:23.473+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:23.547 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:23.542+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:23.547 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:23.544+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:23.812 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:23.809+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:24.053 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:24.050+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:24.098 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:24.095+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:24.451 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:24.448+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:24.516 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:24.513+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:24.561 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:24.557+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:24.561 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:24.558+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:24.768 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:24.765+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:25.064 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:25.061+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:25.131 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:25.127+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:25.495 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:25.491+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:25.545 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:25.542+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:25.554 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:25.550+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:25.556 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:25.553+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:25.789 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:25.786+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:26.052 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:26.049+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:26.170 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:26.167+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:26.499 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:26.496+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:26.566 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:26.563+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:26.567 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:26.564+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:26.594 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:26.591+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:26.772 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:26.769+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:27.038 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:27.032+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:27.157 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:27.155+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:27.462 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:27.458+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:27.568 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:27.565+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:27.571 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:27.569+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:27.592 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:27.589+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:27.805 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:27.802+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:28.009 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:28.005+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:28.143 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:28.140+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:28.499 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:28.495+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:28.553 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:28.548+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:28.553 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:28.550+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:28.594 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:28.591+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:28.808 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:28.805+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:28.992 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:28.990+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:29.123 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:29.119+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:29.505 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:29.501+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:29.526 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:29.520+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:29.526 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:29.522+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:29.620 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:29.617+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:29.789 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:29.787+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:29.977 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:29.972+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:30.130 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:30.127+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:30.481 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:30.477+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:30.492 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:30.486+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:30.492 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:30.487+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:30.649 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:30.643+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:30.760 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:30.757+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:30.964 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:30.961+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:31.137 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:31.135+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:31.525 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:31.521+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:31.534 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:31.530+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:31.537 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:31.534+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:31.673 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:31.670+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:31.760 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:31.757+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:32.007 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:32.004+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:32.146 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:32.137+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:32.501 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:32.495+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:32.589 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:32.585+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:32.591 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:32.588+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:32.708 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:32.705+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:32.755 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:32.752+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:32.985 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:32.982+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:33.139 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:33.136+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:33.468 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:33.464+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:33.603 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:33.599+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:33.614 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:33.604+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:33.681 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:33.679+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:33.800 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:33.797+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:33.952 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:33.950+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:34.143 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:34.140+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:34.427 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:34.422+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:34.622 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:34.617+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:34.622 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:34.618+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:34.716 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:34.712+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:34.783 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:34.779+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:34.975 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:34.971+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:35.131 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:35.128+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:35.464 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:35.460+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:35.655 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:35.651+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:35.657 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:35.653+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:35.763 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:35.761+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:35.767 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:35.764+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:35.958 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:35.955+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:36.175 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:36.172+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:36.513 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:36.508+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:36.678 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:36.673+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:36.679 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:36.674+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:36.747 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:36.744+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:36.812 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:36.808+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:36.978 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:36.972+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:37.145 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:37.143+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:37.266 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:37.262+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:37.502 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:37.497+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:37.704 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:37.698+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:37.704 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:37.700+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:37.745 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:37.743+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:37.825 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:37.822+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:38.026 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:38.023+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:38.175 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:38.173+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:38.318 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:38.313+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:38.465 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:38.461+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:38.693 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:38.688+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:38.693 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:38.689+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:38.744 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:38.741+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:38.837 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:38.834+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:39.031 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:39.028+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:39.222 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:39.219+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:39.328 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:39.322+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:39.514 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:39.509+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:39.697 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:39.692+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:39.702 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:39.696+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:39.743 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:39.740+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:39.825 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:39.823+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:40.040 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:40.037+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:40.236 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:40.232+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:40.313 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:40.307+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:40.498 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:40.491+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:40.676 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:40.671+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:40.676 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:40.672+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:40.783 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:40.781+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:40.840 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:40.838+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:41.055 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:41.052+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:41.223 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:41.219+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:41.294 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:41.289+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:41.529 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:41.525+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:41.649 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:41.645+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:41.651 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:41.648+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:41.783 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:41.781+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:41.866 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:41.864+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:42.060 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:42.057+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:42.258 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:42.254+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:42.284 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:42.279+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:42.517 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:42.513+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:42.678 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:42.673+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:42.680 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:42.677+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:42.823 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:42.820+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:42.902 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:42.900+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:43.078 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:43.074+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:43.262 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:43.259+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:43.322 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:43.318+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:43.562 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:43.557+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:43.662 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:43.657+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:43.662 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:43.658+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:43.790 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:43.787+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:43.922 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:43.919+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:44.066 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:44.063+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:44.221 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:44.218+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:44.323 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:44.319+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:44.531 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:44.526+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:44.669 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:44.664+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:44.669 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:44.665+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:44.841 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:44.838+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:44.898 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:44.893+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:45.033 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:45.030+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:45.272 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:45.268+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:45.361 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:45.356+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:45.576 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:45.572+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:45.625 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:45.620+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:45.626 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:45.622+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:45.891 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:45.887+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:45.908 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:45.905+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:46.066 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:46.063+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:46.249 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:46.246+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:46.319 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:46.314+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:46.564 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:46.559+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:46.586 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:46.581+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:46.587 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:46.583+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:46.881 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:46.878+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:46.905 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:46.903+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:47.083 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:47.079+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:47.224 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:47.221+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:47.281 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:47.277+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:47.557 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:47.552+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:47.640 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:47.634+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:47.640 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:47.636+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:47.876 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:47.873+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:47.919 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:47.915+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:48.115 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:48.112+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:48.195 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:48.193+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:48.311 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:48.307+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:48.602 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:48.597+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:48.665 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:48.659+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:48.666 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:48.661+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:48.892 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:48.889+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:48.947 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:48.944+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:49.132 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:49.130+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:49.176 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:49.173+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:49.346 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:49.342+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:49.618 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:49.614+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:49.618 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:49.614+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:49.640 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:49.636+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:49.885 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:49.881+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:49.974 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:49.971+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:50.161 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:50.158+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:50.217 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:50.214+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:50.303 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:50.298+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:50.601 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:50.596+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:50.601 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:50.597+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:50.686 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:50.682+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:50.915 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:50.912+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:50.930 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:50.927+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:51.122 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:51.119+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:51.210 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:51.206+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:51.341 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:51.336+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:51.626 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:51.619+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:51.630 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:51.626+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:51.694 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:51.690+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:51.947 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:51.945+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:51.972 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:51.969+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:52.039 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:55:52.034+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 45sec e221 v221) 2019-11-25T15:55:52.085 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:52.082+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:52.173 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:52.170+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:52.378 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:52.373+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:52.658 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:52.652+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:52.673 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:52.668+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:52.674 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:52.670+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:52.939 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:52.936+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:52.947 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:52.943+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:53.078 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:53.075+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:53.183 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:53.180+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:53.380 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:53.376+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:53.635 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:53.631+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:53.638 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:53.634+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:53.640 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:53.636+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:53.931 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:53.927+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:53.933 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:53.930+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:54.090 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:54.086+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:54.192 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:54.189+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:54.389 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:54.385+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:54.622 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:54.615+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:54.623 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:54.619+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:54.689 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:54.684+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:54.924 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:54.920+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:54.974 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:54.971+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:55.046 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:55.042+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:55.246 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:55.243+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:55.426 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:55.421+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:55.655 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:55.650+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:55.655 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:55.651+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:55.659 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:55.654+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:55.930 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:55.927+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:55.995 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:55.992+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:56.054 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:56.050+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:56.266 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:55:56.263+0000 16949700 -1 osd.1 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.198915+0000 front 2019-11-25T15:54:35.033460+0000 (oldest deadline 2019-11-25T15:55:20.479712+0000) 2019-11-25T15:55:56.469 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:55:56.464+0000 16949700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:36.485594+0000 front 2019-11-25T15:54:36.204112+0000 (oldest deadline 2019-11-25T15:55:36.537841+0000) 2019-11-25T15:55:56.687 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:56.681+0000 16949700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.998631+0000 front 2019-11-25T15:54:35.894696+0000 (oldest deadline 2019-11-25T15:55:18.691592+0000) 2019-11-25T15:55:56.687 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:56.683+0000 16949700 -1 osd.7 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:56.709 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:55:56.704+0000 16949700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.268384+0000 front 2019-11-25T15:54:34.819624+0000 (oldest deadline 2019-11-25T15:55:20.098027+0000) 2019-11-25T15:55:56.980 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:55:56.977+0000 16949700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:35.672737+0000 front 2019-11-25T15:54:35.675239+0000 (oldest deadline 2019-11-25T15:55:19.087429+0000) 2019-11-25T15:55:56.990 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:55:56.987+0000 16949700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:34.202846+0000 front 2019-11-25T15:54:37.775088+0000 (oldest deadline 2019-11-25T15:55:17.583548+0000) 2019-11-25T15:55:57.097 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:55:57.095+0000 16949700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:54:32.365280+0000 front 2019-11-25T15:54:37.773758+0000 (oldest deadline 2019-11-25T15:55:17.583558+0000) 2019-11-25T15:55:57.122 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:55:57.112+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 45sec e221 v221) 2019-11-25T15:55:57.851 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:57.820+0000 16949700 -1 osd.7 222 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:58.933 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:58.918+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:55:59.946 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:55:59.939+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:00.944 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:00.940+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:01.913 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:01.909+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:02.891 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:02.887+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:03.920 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:31:17.067 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:56:03.920 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:03.917+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:03.929 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:31:17.077 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:56:03.941 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:31:17.191 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:56:03.942 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:31:17.089 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:56:03.946 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:31:17.197 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:56:03.947 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:31:17.095 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:56:04.193 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:31:17.444 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:56:04.196 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:31:17.344 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:56:04.264 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:31:17.412 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:56:04.933 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:04.929+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:05.904 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:05.900+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:06.901 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:06.897+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:07.895 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:07.892+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:08.859 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:08.855+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:09.818 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:09.813+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:10.788 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:10.784+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:11.828 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:11.823+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:12.834 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:12.830+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:13.874 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:13.868+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:14.893 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:14.890+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:15.928 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:15.924+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:16.968 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:16.964+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:18.020 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:18.017+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:18.991 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:18.987+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:19.962 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:19.958+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:20.941 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:20.937+0000 16949700 -1 osd.7 223 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:111679 2.15s0 2:a96fe6df:::b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.655_207fd969fd2447a685af01b1d9adf69c:head [create,setxattr user.rgw.idtag (48) in=62b,setxattr user.rgw.tail_tag (48) in=65b,writefull 0~10014 in=10014b,setxattr user.rgw.manifest (361) in=378b,setxattr user.rgw.acl (193) in=205b,setxattr user.rgw.compression (56) in=76b,setxattr user.rgw.content_type (33) in=54b,setxattr user.rgw.etag (32) in=45b,call rgw.obj_store_pg_ver in=44b,setxattr user.rgw.source_zone (4) in=24b] snapc 0=[] ondisk+write+known_if_redirected e221) 2019-11-25T15:56:28.759 INFO:teuthology.orchestra.run.smithi135.stderr:testSerialization (test.functional.tests.TestFile) ... ok 2019-11-25T15:56:54.440 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:56:54.434+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:56:54.468 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:56:54.465+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:56:54.835 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:56:54.832+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:56:54.996 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:54.992+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:56:55.399 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:56:55.394+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:56:55.478 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:56:55.475+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:56:55.827 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:56:55.823+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:56:55.956 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:55.950+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:56:56.006 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:56:56.003+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:56:56.421 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:56:56.416+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:56:56.501 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:56:56.497+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:56:56.573 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:56:56.567+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:56:56.860 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:56:56.856+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:56:56.970 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:56.965+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:56:57.053 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:56:57.051+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:56:57.464 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:56:57.460+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:56:57.551 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:56:57.546+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:56:57.580 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:56:57.577+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:56:57.899 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:56:57.896+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:56:57.929 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:57.925+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:56:58.040 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:56:58.037+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:56:58.425 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:56:58.421+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:56:58.583 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:56:58.581+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:56:58.625 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:56:58.622+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:56:58.912 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:56:58.909+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:56:58.976 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:58.971+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:56:59.027 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:56:59.023+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:56:59.367 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:56:59.363+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:56:59.472 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:56:59.467+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:56:59.556 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:56:59.553+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:56:59.661 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:56:59.658+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:56:59.961 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:56:59.956+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:56:59.971 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:56:59.966+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:00.033 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:00.029+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:00.407 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:00.403+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:00.495 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:00.490+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:00.536 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:00.532+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:00.691 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:00.687+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:00.945 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:00.943+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:00.985 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:00.980+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:01.028 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:01.024+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:01.368 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:01.365+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:01.471 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:01.465+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:01.590 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:01.587+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:01.740 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:01.733+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:01.965 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:01.959+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:02.006 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:02.002+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:02.063 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:02.060+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:02.420 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:02.415+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:02.489 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:02.485+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:02.566 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:02.562+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:02.751 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:02.748+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:02.996 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:02.991+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:03.005 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:03.001+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:03.096 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:03.093+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:03.410 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:03.405+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:03.449 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:03.444+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:03.602 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:03.598+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:03.785 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:03.781+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:04.013 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:04.007+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:04.087 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:04.083+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:04.142 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:04.127+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:04.415 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:04.411+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:04.453 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:04.449+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:04.648 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:04.646+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:04.818 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:04.814+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:04.981 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:04.976+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:05.089 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:05.085+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:05.139 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:05.135+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:05.375 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:05.370+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:05.440 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:05.436+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:05.617 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:05.613+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:05.863 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:05.860+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:05.960 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:05.954+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:06.055 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:06.049+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:06.125 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:06.122+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:06.357 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:06.347+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:06.361 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:06.354+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:06.402 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:06.397+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:06.605 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:06.601+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:06.842 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:06.838+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:06.948 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:06.941+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:07.062 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:07.058+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:07.162 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:07.159+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:07.368 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:07.363+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:07.410 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:07.405+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:07.411 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:07.407+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:07.604 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:07.602+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:07.867 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:07.862+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:07.975 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:07.970+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:08.057 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:08.049+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:08.346 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:08.341+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:08.408 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:08.403+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:08.412 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:08.402+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:08.414 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:08.408+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:08.577 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:08.573+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:08.848 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:08.844+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:08.979 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:08.975+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:09.097 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:09.094+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:09.332 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:09.327+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:09.415 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:09.410+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:09.416 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:09.412+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:09.482 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:09.403+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:09.628 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:09.626+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:09.895 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:09.888+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:10.010 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:10.006+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:10.124 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:10.121+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:10.358 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:10.354+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:10.366 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:10.363+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:10.409 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:10.404+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:10.411 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:10.408+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:10.643 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:10.640+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:10.931 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:10.928+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:11.064 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:11.059+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:11.179 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:11.176+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:11.393 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:11.389+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:11.395 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:11.392+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:11.401 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:11.396+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:11.408 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:11.404+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:11.668 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:11.663+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:11.893 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:11.891+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:12.070 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:12.065+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:12.181 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:12.178+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:12.367 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:12.362+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:12.370 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:12.366+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:12.392 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:12.387+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:12.437 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:12.434+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:12.717 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:12.714+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:12.911 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:12.909+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:13.094 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:13.090+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:13.193 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:13.189+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:13.351 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:13.347+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:13.419 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:13.415+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:13.420 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:13.416+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:13.425 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:13.423+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:13.764 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:13.761+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:13.925 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:13.921+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:14.144 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:14.140+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:14.147 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:14.144+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:14.373 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:14.369+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:14.450 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:14.447+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:14.455 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:14.450+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:14.456 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:14.451+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:14.724 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:14.721+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:15.047 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:15.043+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:15.098 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:15.094+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:15.123 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:15.120+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:15.345 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:15.340+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:15.481 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:15.478+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:15.504 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:15.499+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:15.505 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:15.500+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:15.690 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:15.687+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:16.048 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:16.045+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:16.094 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:16.090+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:16.112 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:16.107+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:16.312 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:16.307+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:16.462 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:16.457+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:16.463 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:16.458+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:16.659 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:16.598+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:16.736 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:16.733+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:17.047 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:17.037+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:17.091 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:17.087+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:17.092 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:17.089+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:17.363 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:17.356+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:17.429 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:17.424+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:17.431 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:17.427+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:17.704 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:17.702+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:17.754 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:17.751+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:18.012 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:18.008+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:18.127 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:18.124+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:18.142 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:18.138+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:18.319 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:18.315+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:18.396 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:18.391+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:18.399 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:18.395+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:18.685 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:18.682+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:18.783 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:18.780+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:19.055 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:19.052+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:19.116 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:19.113+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:19.184 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:19.180+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:19.344 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:19.339+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:19.412 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:19.407+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:19.413 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:19.408+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:19.736 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:19.732+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:19.803 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:19.801+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:20.037 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:20.033+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:20.097 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:20.094+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:20.220 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:20.215+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:20.304 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:20.300+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:20.374 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:20.368+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:20.377 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:20.370+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:20.774 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:20.766+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:20.832 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:20.828+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:21.030 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:21.026+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:21.089 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:21.086+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:21.201 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:21.196+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:21.351 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:21.346+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:21.402 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:21.398+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:21.404 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:21.400+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:21.843 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:21.837+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:21.875 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:21.873+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:21.998 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:21.996+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:22.063 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:22.060+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:22.254 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:22.249+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:22.369 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:22.365+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:22.442 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:22.438+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:22.444 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:22.440+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:22.820 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:22.817+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:22.897 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:22.895+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:23.034 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:23.031+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:23.044 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:23.041+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:23.269 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:23.264+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:23.382 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:23.378+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:23.474 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:23.469+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:23.475 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:23.471+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:23.808 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:23.803+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:23.867 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:23.864+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:24.059 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:24.055+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:24.061 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:24.058+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:24.253 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:24.244+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:24.347 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:24.342+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:24.498 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:24.492+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:24.499 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:24.493+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:24.824 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:24.820+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:24.847 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:24.843+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:25.062 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:25.059+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:25.070 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:25.067+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:25.245 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:25.241+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:25.348 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:25.344+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:25.474 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:25.470+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:25.475 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:25.470+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:25.866 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:25.864+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:25.872 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:25.870+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:26.060 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:26.057+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:26.088 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:26.086+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:26.201 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:26.198+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:26.309 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:26.304+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:26.513 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:26.508+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:26.514 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:26.509+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:26.868 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:26.864+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:27.025 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:27.021+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:27.066 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:27.063+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:27.082 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:27.078+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:27.249 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:27.245+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:27.328 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:27.323+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:27.443 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:57:27.438+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 43sec e227 v227) 2019-11-25T15:57:27.515 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:27.511+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:27.516 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:27.513+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:27.848 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:27.844+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:28.067 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:28.061+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:28.077 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:28.072+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:28.131 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:28.127+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:28.250 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:28.246+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:28.329 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:28.325+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:28.487 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:28.482+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:28.487 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:28.484+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:28.828 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:28.823+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:29.117 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:29.112+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:29.145 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:29.141+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:29.151 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:29.148+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:29.250 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:29.247+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:29.316 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:29.313+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:29.521 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:29.517+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:29.523 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:29.518+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:29.797 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:29.792+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:30.120 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:30.116+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:30.155 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:30.151+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:30.193 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:30.190+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:30.207 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:30.202+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:30.340 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:30.336+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:30.488 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:30.483+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:30.488 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:30.485+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:30.782 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:30.777+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:31.126 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:31.122+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:31.153 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:31.149+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:31.220 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:31.216+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:31.238 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:31.234+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:31.307 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:31.304+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:31.513 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:31.508+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:31.513 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:31.510+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:31.795 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:31.792+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:32.097 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:32.094+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:32.179 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:32.175+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:32.217 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:32.209+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:32.257 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:32.253+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:32.283 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:32.279+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:32.463 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:57:32.458+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 43sec e227 v227) 2019-11-25T15:57:32.557 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:32.552+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:32.558 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:32.555+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:32.802 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:32.800+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:33.101 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:33.098+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:33.226 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:33.223+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:33.253 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:33.250+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:33.258 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:33.255+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:33.261 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:33.259+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:33.560 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:33.555+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:33.563 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:33.557+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:33.783 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:33.779+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:34.069 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:34.065+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:34.219 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:34.215+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:34.272 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:34.269+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:34.279 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:34.276+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:34.295 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:34.293+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:34.522 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:34.517+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:34.522 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:34.519+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:34.772 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:34.768+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:35.104 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:35.101+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:35.236 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:35.232+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:35.271 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:35.267+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:35.272 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:35.267+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:35.331 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:35.327+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:35.574 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:35.570+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:35.576 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:35.573+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:35.807 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:35.805+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:36.138 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:36.134+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:36.255 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:36.251+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:36.277 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:36.274+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:36.319 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:36.314+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:36.327 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:36.324+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:36.557 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:36.553+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:36.560 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:36.557+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:36.854 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:57:36.851+0000 16949700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.139470+0000 front 2019-11-25T15:56:14.137227+0000 (oldest deadline 2019-11-25T15:56:53.827943+0000) 2019-11-25T15:57:37.185 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:57:37.182+0000 16949700 -1 osd.2 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:14.144653+0000 front 2019-11-25T15:56:14.657894+0000 (oldest deadline 2019-11-25T15:56:55.170883+0000) 2019-11-25T15:57:37.210 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:57:37.206+0000 16949700 -1 osd.3 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:11.766334+0000 front 2019-11-25T15:56:11.360725+0000 (oldest deadline 2019-11-25T15:56:56.334973+0000) 2019-11-25T15:57:37.246 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:57:37.243+0000 16949700 -1 osd.1 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:13.911176+0000 front 2019-11-25T15:56:11.841232+0000 (oldest deadline 2019-11-25T15:56:53.859819+0000) 2019-11-25T15:57:37.362 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:57:37.358+0000 16949700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:10.851644+0000 front 2019-11-25T15:56:10.862996+0000 (oldest deadline 2019-11-25T15:56:54.239408+0000) 2019-11-25T15:57:37.374 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:57:37.371+0000 16949700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T15:56:09.523800+0000 front 2019-11-25T15:56:09.628271+0000 (oldest deadline 2019-11-25T15:56:54.738660+0000) 2019-11-25T15:57:37.521 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:37.516+0000 16949700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T15:56:25.644504+0000 (oldest deadline 2019-11-25T15:57:05.644504+0000) 2019-11-25T15:57:37.522 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T15:57:37.518+0000 16949700 -1 osd.5 227 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e225) 2019-11-25T15:57:37.541 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:57:37.537+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 43sec e227 v227) 2019-11-25T15:58:20.991 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:58:20.983+0000 35a71700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-25T15:58:21.112 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:58:21.091+0000 3a27a700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-25T15:58:21.165 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:58:21.101+0000 35a71700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-25T15:58:21.180 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:58:21.106+0000 38a77700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-25T15:58:21.186 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:58:21.137+0000 3b27c700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-25T15:58:21.362 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:58:21.240+0000 3b27c700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-25T15:58:21.445 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:58:21.360+0000 3a27a700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-25T15:58:21.616 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:58:21.413+0000 38a77700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-25T15:58:34.329 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:58:34.305+0000 37a75700 -1 osd.4 232 build_incremental_map_msg missing incremental map 232 2019-11-25T15:58:53.076 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:34:06.224 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:58:53.089 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:34:06.228 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:58:53.109 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:34:06.359 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:58:53.122 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:34:06.267 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:58:53.122 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:34:06.372 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:58:53.123 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:34:06.270 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:58:53.255 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:34:06.397 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T15:58:53.264 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:34:06.411 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T15:58:53.338 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:34:06.588 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T15:58:55.028 INFO:teuthology.orchestra.run.smithi135.stderr:testStackedOverwrite (test.functional.tests.TestFile) ... ok 2019-11-25T15:58:55.083 INFO:teuthology.orchestra.run.smithi135.stderr:testTooLongName (test.functional.tests.TestFile) ... ok 2019-11-25T15:59:00.297 INFO:teuthology.orchestra.run.smithi135.stderr:testZeroByteFile (test.functional.tests.TestFile) ... ok 2019-11-25T15:59:25.722 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:25.719+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:25.827 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:25.822+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:25.963 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:25.958+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:26.189 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:26.186+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:26.756 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:26.753+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:26.860 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:26.854+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:26.876 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:26.872+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:26.956 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:26.951+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:27.217 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:27.213+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:27.512 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:27.510+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:27.758 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:27.753+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:27.834 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:27.829+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:27.909 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:27.905+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:27.939 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:27.935+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:28.250 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:28.247+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:28.500 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:28.497+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:28.717 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:28.714+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:28.841 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:28.837+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:28.888 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:28.885+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:28.948 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:28.943+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:29.290 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:29.286+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:29.542 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:29.538+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:29.728 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:29.725+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:29.816 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:29.811+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:29.854 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:29.851+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:29.942 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:29.937+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:30.308 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:30.306+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:30.558 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:30.555+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:30.827 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:30.823+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:30.831 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:30.820+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:30.849 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:30.846+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:30.907 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:30.904+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:30.994 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:30.989+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:31.346 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:31.341+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:31.562 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:31.557+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:31.818 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:31.815+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:31.850 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:31.844+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:31.876 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:31.870+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:31.898 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:31.895+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:32.027 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:32.022+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:32.360 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:32.358+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:32.596 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:32.593+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:32.781 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:32.779+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:32.867 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:32.863+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:32.870 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:32.867+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:32.890 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:32.887+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:33.057 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:33.052+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:33.368 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:33.365+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:33.556 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:33.553+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:33.803 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:33.800+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:33.836 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:33.831+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:33.891 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:33.887+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:33.910 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:33.905+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:34.041 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:34.036+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:34.360 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:34.357+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:34.611 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:34.606+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:34.814 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:34.811+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:34.836 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:34.830+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:34.920 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:34.914+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:34.927 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:34.924+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:35.007 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:35.002+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:35.321 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:35.318+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:35.587 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:35.583+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:35.795 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:35.792+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:35.857 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:35.852+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:35.937 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:35.918+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:35.946 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:35.944+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:36.048 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:36.043+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:36.369 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:36.366+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:36.564 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:36.561+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:36.817 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:36.812+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:36.848 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:36.844+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:36.915 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:36.910+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:36.931 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:36.928+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:37.103 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:37.098+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:37.372 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:37.369+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:37.577 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:37.574+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:37.784 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:37.779+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:37.853 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:37.851+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:37.894 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:37.890+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:38.059 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:38.048+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:38.082 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:38.079+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:38.355 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:38.350+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:38.620 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:38.617+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:38.775 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:38.770+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:38.862 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:38.859+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:38.892 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:38.887+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:39.049 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:39.045+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:39.130 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:39.127+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:39.369 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:39.366+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:39.584 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:39.581+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:39.817 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:39.813+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:39.853 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:39.849+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:39.893 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:39.890+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:40.047 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:40.044+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:40.114 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:40.110+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:40.414 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:40.411+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:40.588 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:40.585+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:40.794 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:40.791+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:40.880 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:40.877+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:40.902 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:40.896+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:41.082 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:41.078+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:41.147 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:41.143+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:41.458 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:41.454+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:41.599 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:41.595+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:41.836 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:41.831+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:41.893 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:41.888+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:41.930 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:41.926+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:42.044 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:42.041+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:42.196 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:42.190+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:42.470 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:42.465+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:42.614 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:42.610+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:42.859 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:42.854+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:42.886 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:42.881+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:42.938 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:42.933+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:43.082 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:43.078+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:43.223 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:43.220+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:43.491 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:43.487+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:43.658 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:43.653+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:43.896 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:43.893+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:43.906 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:43.902+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:43.990 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:43.986+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:44.135 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:44.131+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:44.225 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:44.221+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:44.472 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:44.468+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:44.663 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:44.659+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:44.882 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:44.879+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:44.949 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:44.945+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:44.967 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:44.964+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:45.104 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:45.100+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:45.194 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:45.190+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:45.502 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:45.497+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:45.855 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:45.852+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:45.915 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:45.913+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:45.958 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:45.955+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:45.992 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:45.989+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:46.073 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:46.068+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:46.200 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:46.196+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:46.489 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:46.485+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:46.841 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:46.835+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:46.948 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:46.945+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:46.965 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:46.962+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:46.980 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:46.975+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:47.080 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:47.075+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:47.220 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:47.217+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:47.507 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:47.504+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:47.849 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:47.845+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:47.957 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:47.953+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:47.995 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:47.992+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:48.005 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:48.002+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:48.084 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:48.080+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:48.187 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:48.184+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:48.510 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:48.508+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:48.855 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:48.851+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:48.946 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:48.943+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:48.966 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:48.961+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:49.015 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:49.011+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:49.141 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:49.136+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:49.203 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:49.199+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:49.559 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:49.557+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:49.821 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:49.817+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:49.944 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:49.940+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:49.974 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:49.970+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:50.013 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:50.010+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:50.127 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:50.123+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:50.158 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:50.154+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:50.572 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:50.569+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:50.808 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:50.805+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:50.933 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:50.929+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:50.989 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:50.986+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:51.048 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:51.045+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:51.109 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:51.105+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:51.142 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:51.138+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:51.570 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:51.566+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:51.763 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:51.761+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:51.946 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:51.942+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:51.994 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:51.992+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:52.069 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:52.066+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:52.142 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:52.138+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:52.173 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:52.169+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:52.576 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:52.573+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:52.758 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:52.755+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:52.929 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:52.923+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:52.998 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:52.996+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:53.089 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:53.083+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:53.155 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:53.151+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:53.308 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:53.303+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:53.559 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:53.557+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:53.789 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:53.783+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:53.963 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:53.959+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:53.966 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:53.961+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:54.068 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:54.066+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:54.119 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:54.114+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:54.303 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:54.299+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:54.566 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:54.564+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:54.772 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:54.769+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:54.997 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:54.992+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:55.004 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:55.001+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:55.076 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:55.074+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:55.103 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:55.097+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:55.276 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:55.271+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:55.585 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:55.581+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:55.809 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:55.806+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:55.951 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:55.946+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:56.000 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:55.998+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:56.088 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:56.084+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:56.089 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:56.084+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:56.312 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:56.307+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:56.581 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:56.578+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:56.778 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:56.775+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:56.959 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:56.954+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:56.961 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:56.959+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:57.108 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:57.103+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:57.110 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:57.108+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:57.303 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:57.298+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:57.634 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:57.630+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:57.754 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:57.749+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:57.944 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:57.939+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:57.986 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:57.984+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:58.141 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:58.137+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:58.143 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T15:59:58.141+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 43sec e232 v232) 2019-11-25T15:59:58.145 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:58.141+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:58.330 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:58.324+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:58.682 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:58.679+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:58.748 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:58.745+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:58.915 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:58.911+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T15:59:59.041 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T15:59:59.038+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T15:59:59.115 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T15:59:59.111+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T15:59:59.160 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T15:59:59.156+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T15:59:59.321 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T15:59:59.316+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T15:59:59.704 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T15:59:59.700+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T15:59:59.725 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T15:59:59.721+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T15:59:59.889 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T15:59:59.885+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T16:00:00.027 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:00:00.025+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T16:00:00.202 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:00:00.198+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T16:00:00.203 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:00:00.200+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T16:00:00.331 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:00:00.323+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T16:00:00.684 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:00:00.681+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T16:00:00.684 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:00:00.681+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T16:00:00.941 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:00:00.937+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T16:00:01.014 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:00:01.011+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T16:00:01.186 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:00:01.180+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T16:00:01.190 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:00:01.186+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T16:00:01.304 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:00:01.298+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T16:00:01.701 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:00:01.697+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T16:00:01.731 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:00:01.727+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T16:00:01.952 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:00:01.945+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T16:00:02.001 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:00:01.997+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T16:00:02.161 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:00:02.158+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T16:00:02.200 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:00:02.196+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T16:00:02.321 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:00:02.315+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T16:00:02.712 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:00:02.708+0000 16949700 -1 osd.1 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:45.076830+0000 front 2019-11-25T15:58:46.331859+0000 (oldest deadline 2019-11-25T15:59:25.337752+0000) 2019-11-25T16:00:02.721 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:00:02.717+0000 16949700 -1 osd.0 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:46.202781+0000 front 2019-11-25T15:58:46.196006+0000 (oldest deadline 2019-11-25T15:59:27.215931+0000) 2019-11-25T16:00:02.952 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:00:02.947+0000 16949700 -1 osd.6 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.975368+0000 front 2019-11-25T15:58:45.460994+0000 (oldest deadline 2019-11-25T15:59:29.948245+0000) 2019-11-25T16:00:02.990 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:00:02.986+0000 16949700 -1 osd.2 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:41.313865+0000 front 2019-11-25T15:58:42.035455+0000 (oldest deadline 2019-11-25T15:59:25.907281+0000) 2019-11-25T16:00:03.191 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:00:03.188+0000 16949700 -1 osd.3 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:43.331791+0000 front 2019-11-25T15:58:43.334232+0000 (oldest deadline 2019-11-25T15:59:25.090094+0000) 2019-11-25T16:00:03.207 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:00:03.188+0000 16949700 -1 osd.7 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:42.021401+0000 front 2019-11-25T15:58:46.163270+0000 (oldest deadline 2019-11-25T15:59:25.704948+0000) 2019-11-25T16:00:03.249 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:00:03.246+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 43sec e232 v232) 2019-11-25T16:00:03.390 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:00:03.370+0000 16949700 -1 osd.4 232 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T15:58:44.897736+0000 front 2019-11-25T15:58:44.895310+0000 (oldest deadline 2019-11-25T15:59:25.413094+0000) 2019-11-25T16:00:05.550 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:35:18.697 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:00:05.561 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:35:18.708 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:00:05.568 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:35:18.818 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:00:05.574 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:35:18.721 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:00:05.575 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:35:18.825 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:00:05.575 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:35:18.722 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:00:05.669 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:35:18.919 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:00:05.677 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:35:18.824 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:00:05.699 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:35:18.846 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:00:45.502 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:00:45.493+0000 11ca9700 -1 osd.5 237 build_incremental_map_msg missing incremental map 237 2019-11-25T16:00:45.685 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:00:45.679+0000 38276700 -1 osd.5 237 build_incremental_map_msg missing incremental map 237 2019-11-25T16:00:45.686 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:00:45.681+0000 38276700 -1 osd.5 237 build_incremental_map_msg missing incremental map 237 2019-11-25T16:00:45.804 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:00:45.696+0000 38276700 -1 osd.5 237 build_incremental_map_msg missing incremental map 237 2019-11-25T16:00:46.198 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:00:46.123+0000 39278700 -1 osd.5 237 build_incremental_map_msg missing incremental map 237 2019-11-25T16:00:47.360 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:00:47.293+0000 34a6f700 -1 osd.5 238 build_incremental_map_msg missing incremental map 238 2019-11-25T16:00:47.910 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:00:47.798+0000 38276700 -1 osd.5 238 build_incremental_map_msg missing incremental map 238 2019-11-25T16:00:51.540 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:00:51.478+0000 3426e700 -1 osd.5 238 build_incremental_map_msg missing incremental map 238 2019-11-25T16:00:53.250 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:00:53.218+0000 35270700 -1 osd.5 238 build_incremental_map_msg missing incremental map 238 2019-11-25T16:01:01.249 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:01.246+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:02.242 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:02.238+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:02.653 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:02.651+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:03.292 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:03.288+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:03.692 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:03.688+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:04.282 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:04.276+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:04.290 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:04.286+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:04.716 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:04.712+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:04.974 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:04.970+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:04.977 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:04.973+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:05.285 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:05.280+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:05.285 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:05.280+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:05.720 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:05.715+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:05.944 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:05.940+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:05.982 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:05.976+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:06.271 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:06.265+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:06.326 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:06.323+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:06.769 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:06.765+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:06.971 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:06.967+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:07.022 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:07.017+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:07.322 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:07.316+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:07.382 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:07.378+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:07.795 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:07.790+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:07.925 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:07.922+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:07.982 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:07.976+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:08.317 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:08.312+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:08.339 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:08.336+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:08.842 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:08.839+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:08.967 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:08.962+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:08.968 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:08.962+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:09.326 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:09.323+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:09.363 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:09.359+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:09.854 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:09.850+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:09.998 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:09.993+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:10.012 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:10.008+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:10.367 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:10.360+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:10.387 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:10.382+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:10.807 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:10.803+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:10.999 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:10.995+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:11.033 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:11.027+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:11.404 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:11.398+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:11.409 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:11.404+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:11.844 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:11.840+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:12.005 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:12.000+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:12.026 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:12.022+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:12.385 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:12.381+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:12.429 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:12.424+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:12.827 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:12.823+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:13.015 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:13.010+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:13.219 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:13.157+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:13.371 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:13.368+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:13.482 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:13.477+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:13.819 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:13.815+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:13.928 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:36:27.075 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:01:13.943 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:36:27.087 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:01:13.980 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:36:27.128 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:01:13.993 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:36:27.140 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:01:14.020 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:36:27.270 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:01:14.026 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:36:27.276 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:01:14.086 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:36:27.233 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:01:14.117 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:36:27.265 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:01:14.140 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:36:27.391 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:01:14.142 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:14.103+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:14.179 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:14.176+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:14.417 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:14.410+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:14.531 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:14.526+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:14.844 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:14.840+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:15.061 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:15.057+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:15.176 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:15.172+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:15.344 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:15.330+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:15.457 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:15.454+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:15.538 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:15.533+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:15.827 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:15.824+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:16.117 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:16.111+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:16.276 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:16.273+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:16.364 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:16.361+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:16.484 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:16.481+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:16.498 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:16.492+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:16.872 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:16.870+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:17.076 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:17.071+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:17.266 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:17.262+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:17.403 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:17.398+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:17.473 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:17.469+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:17.507 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:17.504+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:17.909 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:17.906+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:18.104 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:18.099+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:18.285 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:18.282+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:18.401 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:18.398+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:18.475 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:18.470+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:18.543 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:18.535+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:18.942 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:18.940+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:19.147 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:19.142+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:19.301 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:19.298+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:19.435 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:19.431+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:19.438 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:19.435+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:19.514 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:19.509+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:19.560 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:19.556+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:19.994 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:19.990+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:20.146 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:20.142+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:20.265 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:20.262+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:20.481 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:20.477+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:20.487 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:20.483+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:20.542 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:20.538+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:20.568 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:20.561+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:20.958 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:20.955+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:21.169 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:21.164+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:21.236 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:21.232+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:21.505 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:21.501+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:21.509 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:21.506+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:21.519 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:21.514+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:21.583 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:21.580+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:21.997 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:21.994+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:22.167 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:22.162+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:22.254 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:22.249+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:22.485 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:22.482+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:22.546 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:22.543+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:22.556 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:22.550+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:22.557 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:22.552+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:22.565 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:22.560+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:23.037 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:23.034+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:23.165 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:23.160+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:23.281 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:23.277+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:23.505 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:23.501+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:23.535 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:23.532+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:23.567 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:23.562+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:23.568 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:23.563+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:23.583 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:23.578+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:24.039 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:24.036+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:24.193 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:24.188+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:24.280 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:24.276+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:24.523 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:24.519+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:24.581 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:24.577+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:24.603 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:24.599+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:24.607 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:24.603+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:24.621 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:24.616+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:25.005 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:25.002+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:25.196 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:25.192+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:25.303 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:25.300+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:25.559 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:25.556+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:25.562 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:25.558+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:25.570 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:25.565+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:25.573 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:25.569+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:25.643 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:25.638+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:26.046 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:26.043+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:26.219 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:26.213+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:26.267 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:26.263+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:26.551 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:26.547+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:26.556 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:26.552+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:26.600 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:26.596+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:26.601 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:26.596+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:26.603 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:26.601+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:27.057 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:27.054+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:27.232 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:27.228+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:27.250 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:27.245+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:27.608 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:27.604+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:27.610 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:27.607+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:27.611 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:27.606+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:27.635 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:27.632+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:27.653 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:27.648+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:28.096 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:28.093+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:28.247 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:28.244+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:28.294 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:28.290+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:28.573 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:28.568+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:28.575 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:28.571+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:28.618 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:28.614+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:28.635 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:28.632+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:28.656 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:28.653+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:29.122 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:29.118+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:29.268 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:29.265+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:29.315 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:29.310+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:29.555 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:29.549+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:29.556 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:29.551+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:29.594 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:29.589+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:29.651 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:29.648+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:29.676 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:29.673+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:30.102 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:30.100+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:30.237 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:30.233+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:30.304 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:30.299+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:30.558 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:30.553+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:30.565 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:30.553+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:30.566 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:30.554+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:30.651 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:30.648+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:30.796 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:30.793+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:31.088 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:31.084+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:31.228 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:31.225+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:31.342 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:31.337+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:31.553 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:31.547+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:31.554 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:31.549+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:31.566 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:31.561+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:31.657 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:31.653+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:31.844 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:31.841+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:32.065 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:32.061+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:32.239 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:32.235+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:32.386 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:32.381+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:32.556 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:32.551+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:32.557 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:32.552+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:32.560 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:32.551+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:32.698 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:32.695+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:32.880 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:32.821+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:33.065 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:33.060+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:33.258 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:33.252+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:33.402 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:33.397+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:33.523 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:33.518+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:33.524 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:33.519+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:33.579 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:33.575+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:33.828 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:33.822+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:33.910 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:01:33.905+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 46sec e238 v238) 2019-11-25T16:01:34.074 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:33.960+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:34.102 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:34.099+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:34.278 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:34.274+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:34.379 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:34.373+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:34.484 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:34.478+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:34.488 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:34.484+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:34.601 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:34.595+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:34.802 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:34.798+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:35.016 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:35.012+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:35.153 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:35.149+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:35.259 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:35.255+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:35.334 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:35.330+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:35.491 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:35.485+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:35.492 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:35.487+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:35.622 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:35.616+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:35.851 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:35.846+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:36.071 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:36.065+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:36.151 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:36.148+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:36.242 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:36.239+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:36.345 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:36.340+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:36.545 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:36.537+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:36.546 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:36.539+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:36.650 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:36.645+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:36.863 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:36.859+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:37.100 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:37.086+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:37.171 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:37.168+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:37.274 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:37.271+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:37.344 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:37.339+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:37.535 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:37.529+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:37.536 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:37.531+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:37.638 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:37.633+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:38.064 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:38.061+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:38.138 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:38.134+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:38.165 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:38.162+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:38.290 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:38.287+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:38.396 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:38.392+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:38.562 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:38.555+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:38.562 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:38.556+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:38.647 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:38.642+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:38.930 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:01:38.923+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 46sec e238 v238) 2019-11-25T16:01:39.080 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:39.077+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:39.185 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:39.182+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:39.316 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:39.313+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:39.329 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:39.325+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:39.391 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:39.386+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:39.593 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:39.587+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:39.593 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:39.589+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:39.676 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:39.670+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:40.160 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:40.157+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:40.217 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:40.211+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:40.303 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:40.301+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:40.388 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:40.383+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:40.623 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:40.619+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:40.626 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:40.622+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:40.684 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:40.680+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:41.147 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:41.144+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:41.205 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:41.203+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:41.261 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:41.256+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:41.337 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:41.329+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:41.399 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:41.395+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:41.624 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:41.619+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:41.626 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:41.622+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:41.709 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:41.703+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:42.139 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:42.136+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:42.283 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:42.280+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:42.316 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:42.260+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:42.407 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:42.403+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:42.421 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:42.416+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:42.609 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:42.604+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:42.611 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:42.608+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:42.706 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:42.702+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:43.181 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:43.177+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:43.272 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:43.270+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:43.363 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:43.359+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:43.447 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:43.443+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:43.470 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:43.466+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:43.639 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:43.633+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:43.640 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:43.635+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:43.751 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:43.746+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:43.947 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:01:43.939+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 46sec e238 v238) 2019-11-25T16:01:44.146 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:44.142+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:44.278 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:44.276+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:44.365 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:44.360+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:44.424 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:44.420+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:44.464 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:44.459+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:44.664 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:44.658+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:44.665 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:44.660+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:44.790 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:44.785+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:45.141 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:45.137+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:45.327 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:45.325+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:45.373 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:45.371+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:45.421 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:45.417+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:45.464 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:45.461+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:45.689 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:45.685+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:45.691 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:45.688+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:45.748 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:45.743+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:46.131 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:46.129+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:46.370 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:46.367+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:46.405 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:46.400+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:46.417 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:46.414+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:46.514 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:46.511+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:46.683 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:46.677+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:46.684 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:46.679+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:46.769 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:46.764+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:47.203 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:47.165+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:47.410 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:47.407+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:47.427 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:47.421+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:47.517 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:47.514+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:47.648 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:47.640+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:47.650 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:47.644+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:47.655 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:47.645+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:47.736 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:47.731+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:48.143 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:48.140+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:48.383 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:48.379+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:48.387 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:48.383+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:48.485 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:48.480+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:48.604 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:48.601+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:48.607 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:48.604+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:48.639 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:48.634+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:48.695 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:48.691+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:48.965 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:01:48.960+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 46sec e238 v238) 2019-11-25T16:01:49.166 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:49.163+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:49.341 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:49.337+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:49.424 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:49.421+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:49.533 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:49.528+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:49.569 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:49.565+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:49.572 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:49.569+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:49.659 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:49.656+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:49.692 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:49.689+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:50.125 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:50.122+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:50.362 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:50.358+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:50.435 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:50.430+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:50.509 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:50.506+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:50.546 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:50.542+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:50.548 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:50.546+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:50.653 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:50.649+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:50.709 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:50.705+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:51.093 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:51.083+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:51.401 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:51.396+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:51.480 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:51.476+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:51.508 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:51.505+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:51.565 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:51.561+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:51.566 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:51.563+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:51.617 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:01:51.613+0000 16949700 -1 osd.1 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.687011+0000 front 2019-11-25T16:00:18.387049+0000 (oldest deadline 2019-11-25T16:01:04.171246+0000) 2019-11-25T16:01:51.708 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:51.704+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:52.133 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:52.130+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:52.447 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:52.444+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:52.516 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:52.512+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:52.526 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:52.523+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:52.578 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:52.573+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:52.579 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:52.575+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:52.725 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:52.721+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:53.133 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:53.130+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:53.450 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:53.446+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:53.499 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:53.495+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:53.540 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:53.537+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:53.541 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:53.538+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:53.557 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:53.554+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:53.777 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:53.773+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:53.987 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:01:53.981+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 46sec e238 v238) 2019-11-25T16:01:54.183 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:54.180+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:54.434 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:54.430+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:54.489 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:54.485+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:54.538 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:54.534+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:54.542 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:54.538+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:54.602 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:54.597+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:54.794 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:54.790+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:55.154 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:55.150+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:55.470 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:55.467+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:55.532 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:55.527+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:55.563 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:55.557+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:55.564 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:55.559+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:55.629 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:55.624+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:55.832 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:55.828+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:56.186 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:56.182+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:56.481 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:56.477+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:56.520 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:56.515+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:56.601 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:56.596+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:56.602 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:56.598+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:56.635 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:56.630+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:56.876 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:56.871+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:57.242 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:57.237+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:57.456 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:57.451+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:57.490 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:57.486+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:57.560 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:57.554+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:57.561 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:57.557+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:57.677 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:57.672+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:57.852 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:57.847+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:58.240 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:01:58.236+0000 16949700 -1 osd.3 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.963002+0000 front 2019-11-25T16:00:18.910622+0000 (oldest deadline 2019-11-25T16:01:00.985319+0000) 2019-11-25T16:01:58.418 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:01:58.415+0000 16949700 -1 osd.7 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:19.133833+0000 front 2019-11-25T16:00:18.966443+0000 (oldest deadline 2019-11-25T16:01:04.203572+0000) 2019-11-25T16:01:58.500 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:01:58.496+0000 16949700 -1 osd.2 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:17.518860+0000 front 2019-11-25T16:00:17.651394+0000 (oldest deadline 2019-11-25T16:01:02.198116+0000) 2019-11-25T16:01:58.565 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:58.562+0000 16949700 -1 osd.5 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:00:41.880484+0000 (oldest deadline 2019-11-25T16:01:21.880484+0000) 2019-11-25T16:01:58.568 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:01:58.565+0000 16949700 -1 osd.5 238 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e237) 2019-11-25T16:01:58.659 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:01:58.654+0000 16949700 -1 osd.0 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.405514+0000 front 2019-11-25T16:00:18.261021+0000 (oldest deadline 2019-11-25T16:01:14.429966+0000) 2019-11-25T16:01:58.863 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:01:58.859+0000 16949700 -1 osd.6 238 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:00:18.933612+0000 front 2019-11-25T16:00:18.912803+0000 (oldest deadline 2019-11-25T16:01:04.169571+0000) 2019-11-25T16:01:59.057 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:01:59.053+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 46sec e238 v238) 2019-11-25T16:03:11.749 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:11.747+0000 16949700 -1 osd.1 244 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:12.799 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:12.796+0000 16949700 -1 osd.1 244 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:13.848 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:13.845+0000 16949700 -1 osd.1 244 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:14.823 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:14.821+0000 16949700 -1 osd.1 244 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:15.785 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:15.782+0000 16949700 -1 osd.1 244 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:16.756 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:16.753+0000 16949700 -1 osd.1 244 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:17.776 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:17.773+0000 16949700 -1 osd.1 244 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:18.793 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:18.789+0000 16949700 -1 osd.1 244 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:19.812 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:19.809+0000 16949700 -1 osd.1 244 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:20.845 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:20.842+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:21.894 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:21.892+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:22.882 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:22.880+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:23.911 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:23.907+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:24.944 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:24.940+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:25.969 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:25.965+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:27.018 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:27.014+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:28.058 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:28.055+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:29.047 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:29.044+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:30.065 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:30.063+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:31.057 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:31.055+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:32.100 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:32.096+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:32.101 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:32.098+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:33.005 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:33.000+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:33.056 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:33.052+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:33.057 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:33.054+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:33.983 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:33.978+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:34.011 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:34.008+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:34.042 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:34.038+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:34.043 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:34.039+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:34.501 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:34.497+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:34.959 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:34.954+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:34.998 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:34.994+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:35.081 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:35.076+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:35.081 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:35.078+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:35.528 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:35.524+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:35.605 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:35.599+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:35.877 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:35.874+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:35.966 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:35.961+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:35.991 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:35.987+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:36.125 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:36.121+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:36.125 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:36.123+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:36.527 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:36.522+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:36.644 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:36.639+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:36.909 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:36.903+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:36.934 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:36.928+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:36.978 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:36.974+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:37.111 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:37.107+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:37.112 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:37.109+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:37.541 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:37.536+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:37.647 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:37.642+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:37.941 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:37.936+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:37.944 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:37.940+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:37.948 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:37.942+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:38.073 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:38.069+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:38.076 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:38.074+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:38.541 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:38.537+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:38.657 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:38.653+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:38.973 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:38.970+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:38.980 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:38.977+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:38.990 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:38.985+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:39.059 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:39.056+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:39.061 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:39.059+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:39.585 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:39.580+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:39.632 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:39.626+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:39.948 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:39.945+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:39.958 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:39.953+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:40.031 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:40.027+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:40.070 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:40.066+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:40.071 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:40.068+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:40.566 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:40.562+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:40.613 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:40.608+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:40.930 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:40.925+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:40.966 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:40.963+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:41.035 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:41.032+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:41.046 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:41.042+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:41.046 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:41.044+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:41.590 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:41.585+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:41.613 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:41.609+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:41.901 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:41.896+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:41.986 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:41.983+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:42.061 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:42.058+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:42.062 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:42.060+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:42.064 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:42.062+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:42.549 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:42.543+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:42.655 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:42.650+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:42.876 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:42.872+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:43.018 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:43.014+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:43.025 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:43.022+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:43.062 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:43.058+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:43.063 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:43.060+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:43.589 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:43.584+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:43.619 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:43.614+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:43.873 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:43.868+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:43.994 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:43.990+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:44.054 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:44.051+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:44.063 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:44.061+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:44.064 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:44.061+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:44.580 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:44.576+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:44.610 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:44.605+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:44.854 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:44.850+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:44.957 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:44.953+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:45.077 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:45.067+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:45.115 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:45.110+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:45.115 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:45.112+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:45.540 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:45.535+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:45.602 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:45.598+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:45.830 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:45.824+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:45.930 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:45.926+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:46.055 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:46.052+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:46.085 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:46.082+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:46.086 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:46.083+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:46.521 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:46.515+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:46.601 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:46.596+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:46.862 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:46.857+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:46.894 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:46.891+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:47.021 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:47.017+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:47.076 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:47.073+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:47.076 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:47.074+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:47.550 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:47.546+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:47.573 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:47.568+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:47.856 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:47.851+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:47.860 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:47.857+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:47.992 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:47.988+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:48.126 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:48.123+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:48.126 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:48.124+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:48.516 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:48.511+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:48.570 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:48.565+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:48.877 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:48.872+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:48.899 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:48.896+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:48.961 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:48.958+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:49.169 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:49.166+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:49.171 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:49.169+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:49.518 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:49.513+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:49.549 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:39:02.697 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:03:49.560 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:39:02.707 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:03:49.570 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:39:02.717 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:03:49.571 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:49.567+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:49.573 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:39:02.720 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:03:49.576 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:39:02.826 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:03:49.593 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:39:02.844 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:03:49.735 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:39:02.882 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:03:49.748 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:39:02.895 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:03:49.830 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:39:03.080 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:03:49.883 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:49.881+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:49.885 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:49.881+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:49.960 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:49.957+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:50.165 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:50.162+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:50.165 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:50.163+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:50.528 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:50.522+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:50.582 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:50.578+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:50.854 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:50.849+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:50.919 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:50.915+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:51.009 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:51.006+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:51.185 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:51.181+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:51.185 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:51.183+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:51.502 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:51.497+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:51.575 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:51.570+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:51.905 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:51.901+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:51.947 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:51.943+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:52.045 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:52.041+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:52.225 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:52.221+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:52.226 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:52.223+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:52.503 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:52.498+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:52.541 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:52.536+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:52.956 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:52.952+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:52.978 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:52.974+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:53.046 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:53.043+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:53.187 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:53.184+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:53.189 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:53.187+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:53.513 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:53.508+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:53.525 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:53.520+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:53.927 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:53.922+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:53.992 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:53.989+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:54.069 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:54.065+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:54.219 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:54.216+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:54.221 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:54.219+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:54.511 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:54.506+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:54.517 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:54.512+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:54.945 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:54.939+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:55.030 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:55.027+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:55.033 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:55.031+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:55.192 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:55.188+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:55.193 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:55.190+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:55.482 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:55.477+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:55.540 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:55.535+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:55.924 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:55.919+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:55.994 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:55.990+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:56.023 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:56.020+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:56.185 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:56.181+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:56.186 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:56.183+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:56.513 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:56.507+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:56.518 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:56.513+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:56.957 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:56.953+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:56.966 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:56.961+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:57.011 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:57.007+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:57.172 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:57.167+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:57.172 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:57.169+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:57.485 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:57.480+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:57.511 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:57.506+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:57.961 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:57.958+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:58.001 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:57.995+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:58.007 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:58.005+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:58.202 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:58.198+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:58.204 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:58.200+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:58.452 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:58.448+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:58.532 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:58.528+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:58.966 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:58.963+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:59.001 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:03:58.997+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:03:59.031 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:59.026+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:03:59.168 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:59.163+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:03:59.168 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:03:59.165+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:03:59.495 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:03:59.490+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:03:59.547 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:03:59.543+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:03:59.935 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:03:59.931+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:03:59.994 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:03:59.990+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:04:00.041 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:04:00.038+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:04:00.150 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:00.145+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:04:00.150 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:00.147+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:00.487 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:04:00.484+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:04:00.575 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:04:00.572+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:04:00.619 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:04:00.614+0000 16949700 -1 osd.3 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:54.063320+0000 front 2019-11-25T16:02:49.384591+0000 (oldest deadline 2019-11-25T16:03:59.703027+0000) 2019-11-25T16:04:00.936 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:04:00.933+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:04:01.037 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:04:01.034+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:04:01.091 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:04:01.087+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:04:01.187 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:01.184+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:04:01.190 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:01.187+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:01.451 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:04:01.446+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:04:01.604 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:04:01.599+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:04:01.648 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:04:01.645+0000 16949700 -1 osd.3 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:54.063320+0000 front 2019-11-25T16:02:49.384591+0000 (oldest deadline 2019-11-25T16:03:59.703027+0000) 2019-11-25T16:04:01.930 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:04:01.926+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:04:02.012 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:04:02.008+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:04:02.083 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:04:02.079+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:04:02.163 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:02.160+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:04:02.164 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:02.161+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:02.460 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:04:02.456+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:04:02.619 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:04:02.615+0000 16949700 -1 osd.3 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:54.063320+0000 front 2019-11-25T16:02:49.384591+0000 (oldest deadline 2019-11-25T16:03:59.703027+0000) 2019-11-25T16:04:02.628 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:04:02.625+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:04:02.957 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:04:02.954+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:04:03.039 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:04:03.035+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:04:03.057 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:04:03.054+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:04:03.125 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:03.120+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:04:03.125 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:03.121+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:03.440 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:04:03.436+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:04:03.638 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:04:03.634+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:04:03.656 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:04:03.652+0000 16949700 -1 osd.3 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:54.063320+0000 front 2019-11-25T16:02:49.384591+0000 (oldest deadline 2019-11-25T16:03:59.703027+0000) 2019-11-25T16:04:03.938 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:04:03.935+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:04:04.037 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:04:04.034+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:04:04.063 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:04:04.060+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:04:04.175 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:04.172+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:04:04.175 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:04.173+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:04.400 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:04:04.397+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:04:04.612 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:04:04.608+0000 16949700 -1 osd.3 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:54.063320+0000 front 2019-11-25T16:02:49.384591+0000 (oldest deadline 2019-11-25T16:03:59.703027+0000) 2019-11-25T16:04:04.642 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:04:04.637+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:04:04.914 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:04:04.910+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:04:05.035 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:04:05.031+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:04:05.113 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:04:05.108+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:04:05.171 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:05.168+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:04:05.173 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:05.170+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:05.415 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:04:05.411+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:04:05.574 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:04:05.570+0000 16949700 -1 osd.3 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:54.063320+0000 front 2019-11-25T16:02:49.384591+0000 (oldest deadline 2019-11-25T16:03:59.703027+0000) 2019-11-25T16:04:05.629 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:04:05.625+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:04:05.893 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:04:05.890+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:04:05.998 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:04:05.995+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:04:06.154 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:04:06.151+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:04:06.217 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:06.213+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:04:06.219 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:06.216+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:06.405 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:04:06.401+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:04:06.551 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:04:06.547+0000 16949700 -1 osd.3 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:54.063320+0000 front 2019-11-25T16:02:49.384591+0000 (oldest deadline 2019-11-25T16:03:59.703027+0000) 2019-11-25T16:04:06.627 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:04:06.624+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:04:06.886 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:04:06.883+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:04:07.022 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:04:07.018+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:04:07.183 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:07.179+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:04:07.185 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:04:07.182+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:04:07.186 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:07.183+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:07.359 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:04:07.355+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:04:07.519 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:04:07.516+0000 16949700 -1 osd.3 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:54.063320+0000 front 2019-11-25T16:02:49.384591+0000 (oldest deadline 2019-11-25T16:03:59.703027+0000) 2019-11-25T16:04:07.655 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:04:07.650+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:04:07.926 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:04:07.922+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:04:08.007 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:04:08.003+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:04:08.187 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:04:08.183+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:04:08.211 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:08.208+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:04:08.211 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:08.209+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:08.365 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:04:08.361+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:04:08.538 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:04:08.534+0000 16949700 -1 osd.3 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:54.063320+0000 front 2019-11-25T16:02:49.384591+0000 (oldest deadline 2019-11-25T16:03:59.703027+0000) 2019-11-25T16:04:08.616 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:04:08.611+0000 16949700 -1 osd.4 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:50.049439+0000 front 2019-11-25T16:02:49.428087+0000 (oldest deadline 2019-11-25T16:03:34.687747+0000) 2019-11-25T16:04:08.888 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:04:08.884+0000 16949700 -1 osd.0 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.421723+0000 front 2019-11-25T16:02:49.357088+0000 (oldest deadline 2019-11-25T16:03:34.970584+0000) 2019-11-25T16:04:08.995 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:04:08.991+0000 16949700 -1 osd.2 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.384169+0000 front 2019-11-25T16:02:49.385040+0000 (oldest deadline 2019-11-25T16:03:33.146161+0000) 2019-11-25T16:04:09.156 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:04:09.152+0000 16949700 -1 osd.7 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.806904+0000 front 2019-11-25T16:02:48.776121+0000 (oldest deadline 2019-11-25T16:03:32.569642+0000) 2019-11-25T16:04:09.171 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:09.166+0000 16949700 -1 osd.1 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:49.332329+0000 front 2019-11-25T16:02:53.154402+0000 (oldest deadline 2019-11-25T16:03:31.899217+0000) 2019-11-25T16:04:09.172 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:09.168+0000 16949700 -1 osd.1 244 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:09.343 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:04:09.339+0000 16949700 -1 osd.6 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:48.603109+0000 front 2019-11-25T16:02:48.363293+0000 (oldest deadline 2019-11-25T16:03:34.128888+0000) 2019-11-25T16:04:09.502 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:04:09.497+0000 16949700 -1 osd.3 244 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:02:54.063320+0000 front 2019-11-25T16:02:49.384591+0000 (oldest deadline 2019-11-25T16:03:59.703027+0000) 2019-11-25T16:04:09.580 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:04:09.569+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 46sec e244 v244) 2019-11-25T16:04:10.342 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:10.281+0000 16949700 -1 osd.1 245 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:11.372 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:11.298+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:12.273 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:12.270+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:13.321 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:13.318+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:14.339 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:14.336+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:15.348 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:15.345+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:16.342 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:16.340+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:17.309 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:17.306+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:18.358 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:18.356+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:19.392 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:19.390+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:20.404 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:20.401+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:21.409 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:21.406+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:22.383 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:22.380+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:23.400 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:23.398+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:24.373 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:24.370+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:25.370 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:25.368+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:26.354 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:26.351+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:27.408 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:27.404+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:28.440 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:28.438+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:29.466 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:29.464+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:30.432 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:30.429+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:31.475 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:31.472+0000 16949700 -1 osd.1 246 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:112813 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=237b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:04:32.666 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:04:32.656+0000 16949700 -1 osd.1 246 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:112833 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e244) 2019-11-25T16:05:07.904 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:07.900+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:08.105 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:08.100+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:08.758 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:08.754+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:08.879 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:08.874+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:09.097 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:09.092+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:09.158 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:09.154+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:09.756 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:09.752+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:09.929 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:09.926+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:10.072 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:10.068+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:10.207 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:10.203+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:10.735 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:10.730+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:10.903 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:10.900+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:11.021 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:11.017+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:11.126 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:11.122+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:11.243 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:11.238+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:11.786 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:11.782+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:11.893 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:11.889+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:12.022 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:12.017+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:12.111 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:12.107+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:12.270 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:12.267+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:12.782 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:12.777+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:12.895 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:12.892+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:13.004 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:12.999+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:13.127 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:13.124+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:13.267 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:13.263+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:13.837 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:13.833+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:13.852 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:13.849+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:14.001 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:13.997+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:14.108 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:14.103+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:14.293 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:14.288+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:14.796 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:14.792+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:14.860 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:14.857+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:15.052 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:15.047+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:15.112 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:15.109+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:15.192 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:15.189+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:15.267 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:15.262+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:15.795 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:15.792+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:15.890 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:15.887+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:16.008 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:16.004+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:16.123 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:16.119+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:16.216 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:16.213+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:16.307 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:16.303+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:16.762 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:16.759+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:16.932 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:16.930+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:17.019 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:17.015+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:17.164 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:17.159+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:17.213 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:17.209+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:17.302 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:17.298+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:17.785 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:17.781+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:17.961 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:17.957+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:18.002 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:17.998+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:18.177 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:18.174+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:18.255 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:18.252+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:18.286 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:18.277+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:18.814 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:18.810+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:18.987 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:18.981+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:18.990 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:18.986+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:19.161 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:19.156+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:19.274 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:19.270+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:19.306 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:19.302+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:19.850 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:19.847+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:19.988 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:19.984+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:20.043 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:20.037+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:20.216 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:20.210+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:20.276 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:20.271+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:20.294 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:20.291+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:20.896 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:20.893+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:20.947 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:20.944+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:21.031 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:21.027+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:21.179 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:21.173+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:21.282 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:21.279+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:21.309 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:21.304+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:21.937 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:21.933+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:21.959 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:21.955+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:22.067 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:22.062+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:22.225 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:22.221+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:22.314 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:22.311+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:22.360 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:22.354+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:22.361 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:22.356+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:22.900 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:22.896+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:22.933 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:22.927+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:23.100 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:23.094+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:23.244 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:23.239+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:23.287 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:23.284+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:23.355 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:23.349+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:23.359 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:23.352+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:23.913 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:23.910+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:23.936 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:23.926+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:24.151 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:24.147+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:24.256 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:24.249+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:24.323 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:24.318+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:24.325 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:24.321+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:24.338 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:24.334+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:24.910 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:24.906+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:24.957 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:24.954+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:25.114 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:25.109+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:25.288 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:25.282+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:25.289 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:25.284+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:25.289 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:25.285+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:25.342 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:25.339+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:25.873 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:25.869+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:26.006 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:26.002+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:26.069 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:26.064+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:26.308 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:26.302+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:26.309 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:26.304+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:26.324 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:26.318+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:26.375 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:26.371+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:26.863 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:26.857+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:26.989 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:26.984+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:27.114 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:27.108+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:27.283 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:27.278+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:27.312 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:27.306+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:27.313 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:27.308+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:27.420 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:27.416+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:27.864 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:27.857+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:27.946 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:27.942+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:28.149 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:28.145+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:28.275 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:28.270+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:28.277 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:28.273+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:28.309 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:28.303+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:28.462 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:28.458+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:28.879 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:28.875+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:28.912 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:28.908+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:29.154 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:29.149+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:29.286 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:29.280+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:29.303 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:29.297+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:29.304 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:29.299+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:29.454 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:29.450+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:29.852 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:29.848+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:29.902 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:29.899+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:30.157 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:30.152+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:30.301 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:30.295+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:30.340 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:30.336+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:30.343 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:30.339+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:30.437 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:30.433+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:30.885 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:30.881+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:30.923 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:30.919+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:31.164 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:31.159+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:31.317 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:31.311+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:31.387 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:31.381+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:31.388 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:31.383+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:31.448 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:31.445+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:31.903 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:31.900+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:31.930 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:31.926+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:32.135 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:32.130+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:32.288 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:32.283+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:32.406 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:32.401+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:32.407 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:32.402+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:32.488 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:32.484+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:32.934 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:32.932+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:32.981 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:32.976+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:33.171 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:33.166+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:33.338 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:33.333+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:33.374 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:33.368+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:33.375 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:33.370+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:33.510 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:33.506+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:33.909 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:33.905+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:33.940 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:33.937+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:34.144 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:34.139+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:34.370 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:34.365+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:34.371 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:34.366+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:34.372 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:34.367+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:34.527 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:34.523+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:34.890 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:34.887+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:34.921 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:34.917+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:35.117 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:35.112+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:35.362 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:35.356+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:35.363 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:35.358+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:35.390 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:35.385+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:35.525 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:35.521+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:35.874 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:35.871+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:35.920 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:35.916+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:36.171 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:36.165+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:36.365 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:36.360+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:36.366 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:36.361+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:36.393 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:36.388+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:36.489 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:36.485+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:36.874 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:36.870+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:36.965 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:36.960+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:37.125 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:37.120+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:37.333 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:37.329+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:37.336 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:37.332+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:37.366 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:37.361+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:37.527 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:37.523+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:37.870 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:37.866+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:37.967 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:37.963+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:38.168 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:38.163+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:38.347 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:38.341+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:38.348 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:38.343+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:38.391 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:38.386+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:38.547 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:38.542+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:38.841 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:38.836+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:38.985 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:38.980+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:39.221 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:39.210+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:39.348 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:39.342+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:39.349 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:39.345+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:39.374 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:39.369+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:39.579 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:39.574+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:39.845 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:39.840+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:39.885 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:05:39.868+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e251 v251) 2019-11-25T16:05:40.025 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:40.021+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:40.245 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:40.239+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:40.347 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:40.341+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:40.347 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:40.343+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:40.381 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:40.376+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:40.568 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:40.564+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:40.885 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:40.880+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:41.062 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:41.056+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:41.256 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:41.251+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:41.330 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:41.325+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:41.333 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:41.329+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:41.359 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:41.354+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:41.600 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:41.596+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:41.876 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:41.868+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:42.071 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:42.066+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:42.138 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:42.132+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:42.297 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:42.291+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:42.355 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:42.351+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:42.384 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:42.379+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:42.387 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:42.383+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:42.596 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:42.591+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:42.908 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:42.904+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:43.089 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:43.085+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:43.098 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:43.094+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:43.324 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:43.319+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:43.347 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:43.341+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:43.348 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:43.343+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:43.393 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:43.388+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:43.563 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:43.559+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:43.871 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:43.867+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:44.063 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:44.059+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:44.135 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:44.131+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:44.335 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:44.330+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:44.336 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:44.331+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:44.356 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:44.351+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:44.364 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:44.359+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:44.574 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:44.571+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:44.894 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:05:44.888+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e251 v251) 2019-11-25T16:05:44.909 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:44.905+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:45.039 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:45.036+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:45.137 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:45.133+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:45.333 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:45.328+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:45.348 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:45.343+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:45.375 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:45.371+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:45.378 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:45.374+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:45.571 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:45.568+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:45.907 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:45.904+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:46.059 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:46.055+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:46.190 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:46.186+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:46.304 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:46.298+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:46.308 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:46.302+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:46.372 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:46.367+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:46.376 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:46.371+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:46.549 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:46.547+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:46.952 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:46.948+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:47.046 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:47.041+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:47.167 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:47.164+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:47.286 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:47.280+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:47.323 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:47.318+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:47.383 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:47.377+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:47.384 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:47.379+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:47.598 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:47.594+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:47.988 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:47.984+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:48.099 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:48.095+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:48.213 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:48.210+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:48.291 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:48.284+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:48.307 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:48.302+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:48.346 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:48.340+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:48.346 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:48.342+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:48.627 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:48.624+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:48.944 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:48.940+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:49.077 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:49.072+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:49.244 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:49.240+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:49.281 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:49.275+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:49.327 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:49.322+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:49.357 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:49.352+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:49.360 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:49.356+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:49.608 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:49.605+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:49.904 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:05:49.901+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e251 v251) 2019-11-25T16:05:49.914 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:49.911+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:50.033 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:50.030+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:50.239 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:50.236+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:50.272 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:50.267+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:50.329 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:50.323+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:50.330 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:50.325+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:50.347 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:50.342+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:50.660 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:50.656+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:50.962 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:50.959+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:51.033 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:51.030+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:51.222 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:51.218+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:51.313 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:51.308+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:51.324 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:51.319+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:51.329 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:51.323+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:51.330 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:51.325+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:51.617 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:51.613+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:51.975 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:51.972+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:52.055 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:52.052+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:52.224 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:52.220+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:52.336 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:52.330+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:52.360 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:52.355+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:52.361 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:52.356+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:52.366 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:52.361+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:52.636 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:52.632+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:52.939 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:52.934+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:53.073 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:53.069+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:53.192 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:53.188+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:53.342 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:53.336+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:53.385 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:53.379+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:53.389 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:53.384+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:53.390 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:53.385+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:53.673 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:53.663+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:53.902 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:53.899+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:54.113 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:54.109+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:54.217 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:54.212+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:54.376 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:54.371+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:54.389 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:54.383+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:54.434 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:54.429+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:54.437 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:54.432+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:54.659 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:54.655+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:54.882 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:54.878+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:54.928 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:05:54.921+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e251 v251) 2019-11-25T16:05:55.162 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:55.159+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:55.269 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:55.266+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:55.348 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:55.343+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:55.399 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:55.394+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:55.448 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:55.443+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:55.448 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:55.444+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:55.683 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:55.679+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:55.924 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:55.921+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:56.122 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:56.118+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:56.286 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:56.283+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:56.383 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:56.379+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:56.406 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:56.401+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:56.422 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:56.417+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:56.423 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:56.419+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:56.681 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:56.676+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:56.961 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:56.958+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:57.149 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:57.145+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:57.295 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:57.291+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:57.397 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:57.392+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:57.398 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:57.393+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:57.404 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:57.399+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:57.422 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:57.416+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:57.719 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:57.714+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:57.933 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:57.929+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:58.115 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:58.112+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:58.333 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:58.330+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:58.381 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:58.376+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:58.384 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:58.380+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:58.408 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:58.401+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:58.440 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:58.436+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:58.732 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:58.728+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:58.950 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:58.945+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:05:59.161 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:05:59.157+0000 16949700 -1 osd.1 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.827171+0000 front 2019-11-25T16:04:26.831548+0000 (oldest deadline 2019-11-25T16:05:41.912182+0000) 2019-11-25T16:05:59.369 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:05:59.363+0000 16949700 -1 osd.3 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:25.856616+0000 front 2019-11-25T16:04:25.622347+0000 (oldest deadline 2019-11-25T16:05:07.301180+0000) 2019-11-25T16:05:59.377 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:05:59.371+0000 16949700 -1 osd.7 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:24.651139+0000 front 2019-11-25T16:04:24.286141+0000 (oldest deadline 2019-11-25T16:05:07.726723+0000) 2019-11-25T16:05:59.435 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:59.430+0000 16949700 -1 osd.5 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:04:41.989931+0000 (oldest deadline 2019-11-25T16:05:21.989931+0000) 2019-11-25T16:05:59.437 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:05:59.433+0000 16949700 -1 osd.5 251 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:05:59.481 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:05:59.476+0000 16949700 -1 osd.6 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:26.823127+0000 front 2019-11-25T16:04:26.821110+0000 (oldest deadline 2019-11-25T16:05:10.298356+0000) 2019-11-25T16:05:59.768 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:05:59.765+0000 16949700 -1 osd.2 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.106261+0000 front 2019-11-25T16:04:23.482723+0000 (oldest deadline 2019-11-25T16:05:08.239945+0000) 2019-11-25T16:05:59.990 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:05:59.986+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 42sec e251 v251) 2019-11-25T16:06:00.001 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:05:59.999+0000 16949700 -1 osd.0 251 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:04:23.189764+0000 front 2019-11-25T16:04:24.336020+0000 (oldest deadline 2019-11-25T16:05:08.361872+0000) 2019-11-25T16:06:00.586 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:06:00.549+0000 16949700 -1 osd.5 252 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e248) 2019-11-25T16:07:11.582 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:11.577+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:12.599 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:12.595+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:13.594 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:13.591+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:14.587 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:14.585+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:15.500 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:42:28.647 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:15.538 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:42:28.685 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:15.540 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:42:28.685 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:15.557 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:42:28.704 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:15.584 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:42:28.834 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:15.588 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:42:28.838 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:15.621 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:15.618+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:15.772 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:42:28.918 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:15.772 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:42:28.918 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:15.821 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:42:29.071 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:16.614 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:16.611+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:17.657 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:17.654+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:18.662 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:18.659+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:19.700 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:19.697+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:20.748 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:20.745+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:21.788 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:21.785+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:22.744 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:22.742+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:23.757 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:23.754+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:24.779 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:24.776+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:25.756 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:25.753+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:26.792 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:26.789+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:27.761 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:27.758+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:28.789 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:28.786+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:29.819 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:29.816+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:30.784 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:30.781+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:31.823 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:31.818+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:32.362 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:42:45.509 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:32.366 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:42:45.513 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:32.376 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:42:45.627 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:32.378 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:42:45.525 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:32.383 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:42:45.633 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:32.384 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:42:45.531 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:32.403 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:42:45.550 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:32.418 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:42:45.669 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:32.427 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:42:45.570 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:07:32.814 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:32.812+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:33.844 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:33.841+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:34.897 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:34.895+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:35.505 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:35.500+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:35.871 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:35.869+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:36.294 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:36.291+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:36.382 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:36.379+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:36.520 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:36.513+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:36.853 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:36.851+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:37.017 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:37.012+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:37.348 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:37.344+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:37.378 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:37.374+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:37.496 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:37.491+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:37.868 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:37.865+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:37.869 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:37.867+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:38.050 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:38.043+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:38.333 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:38.327+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:38.377 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:38.373+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:38.466 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:38.461+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:38.888 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:38.884+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:38.888 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:38.885+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:39.058 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:39.054+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:39.359 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:39.356+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:39.412 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:39.410+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:39.503 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:39.498+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:39.618 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:39.614+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:39.871 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:39.868+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:39.874 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:39.871+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:40.086 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:40.079+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:40.379 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:40.375+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:40.401 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:40.399+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:40.467 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:40.462+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:40.649 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:40.646+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:40.863 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:40.860+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:40.865 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:40.863+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:40.952 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:40.947+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:41.095 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:41.090+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:41.415 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:41.411+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:41.416 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:41.411+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:41.519 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:41.514+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:41.616 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:41.613+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:41.876 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:41.871+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:41.877 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:41.873+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:41.927 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:41.923+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:42.108 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:42.103+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:42.402 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:42.399+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:42.415 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:42.412+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:42.516 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:42.511+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:42.653 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:42.650+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:42.916 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:42.911+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:42.927 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:42.925+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:42.929 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:42.927+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:43.093 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:43.089+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:43.415 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:43.410+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:43.443 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:43.439+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:43.500 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:43.496+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:43.702 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:43.697+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:43.934 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:43.929+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:43.982 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:43.974+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:43.984 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:43.980+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:44.056 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:44.051+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:44.459 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:44.455+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:44.465 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:44.462+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:44.496 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:44.491+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:44.758 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:44.754+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:44.918 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:44.911+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:45.026 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:45.022+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:45.027 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:45.024+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:45.110 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:45.105+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:45.469 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:45.465+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:45.513 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:45.510+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:45.518 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:45.513+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:45.769 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:45.766+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:45.922 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:45.917+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:46.057 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:46.052+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:46.057 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:46.054+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:46.122 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:46.117+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:46.453 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:46.450+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:46.472 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:46.467+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:46.483 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:46.478+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:46.737 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:46.733+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:46.919 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:46.915+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:47.025 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:47.022+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:47.028 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:47.026+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:47.079 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:47.073+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:47.419 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:47.416+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:47.476 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:47.466+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:47.502 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:47.497+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:47.698 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:47.694+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:47.910 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:47.904+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:48.041 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:48.037+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:48.042 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:48.039+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:48.088 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:48.083+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:48.389 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:48.386+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:48.462 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:48.456+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:48.473 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:48.470+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:48.701 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:48.698+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:48.943 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:48.936+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:49.083 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:49.075+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:49.085 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:49.077+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:49.123 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:49.117+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:49.376 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:49.372+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:49.467 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:49.462+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:49.504 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:49.500+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:49.754 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:49.746+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:49.996 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:49.991+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:50.045 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:50.042+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:50.046 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:50.043+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:50.117 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:50.113+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:50.402 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:50.399+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:50.516 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:50.512+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:50.546 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:50.544+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:50.807 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:50.802+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:51.019 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:51.016+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:51.020 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:51.017+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:51.051 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:51.047+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:51.172 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:51.167+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:51.406 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:51.401+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:51.483 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:51.478+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:51.548 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:51.544+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:51.810 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:51.806+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:52.008 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:52.005+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:52.010 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:52.008+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:52.043 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:52.038+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:52.198 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:52.194+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:52.434 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:52.430+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:52.498 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:52.492+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:52.589 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:52.585+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:52.783 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:52.779+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:53.002 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:52.996+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:53.019 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:53.016+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:53.021 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:53.018+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:53.203 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:53.198+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:53.422 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:53.418+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:53.569 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:53.564+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:53.614 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:53.609+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:53.812 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:53.807+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:53.989 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:53.984+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:54.022 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:54.017+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:54.023 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:54.019+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:54.217 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:54.211+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:54.416 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:54.408+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:54.527 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:54.522+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:54.643 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:54.636+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:54.827 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:54.822+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:54.984 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:54.979+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:55.012 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:55.007+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:55.013 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:55.009+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:55.244 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:55.238+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:55.433 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:55.428+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:55.526 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:55.521+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:55.623 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:55.618+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:55.826 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:55.820+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:55.946 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:55.941+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:56.045 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:56.040+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:56.046 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:56.042+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:56.287 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:56.282+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:56.430 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:56.425+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:56.491 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:56.486+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:56.655 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:56.651+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:56.823 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:56.818+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:56.946 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:56.940+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:57.031 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:57.026+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:57.031 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:57.027+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:57.307 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:57.302+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:57.392 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:57.388+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:57.470 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:57.465+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:57.622 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:57.618+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:57.796 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:57.792+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:57.957 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:57.953+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:57.996 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:57.992+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:57.997 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:57.993+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:58.288 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:58.283+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:58.353 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:58.350+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:58.507 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:58.502+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:58.623 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:58.619+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:58.778 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:58.774+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:58.940 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:58.934+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:07:59.014 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:59.011+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:07:59.016 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:07:59.014+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:07:59.300 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:07:59.294+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:07:59.323 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:07:59.320+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:07:59.556 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:07:59.550+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:07:59.591 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:07:59.587+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:07:59.822 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:07:59.818+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:07:59.973 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:07:59.968+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:00.031 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:00.027+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:00.034 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:00.031+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:00.318 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:00.312+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:00.348 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:00.344+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:00.582 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:00.577+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:00.584 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:00.581+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:00.861 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:00.858+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:00.934 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:00.929+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:01.045 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:01.040+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:01.045 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:01.042+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:01.304 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:01.300+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:01.371 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:01.365+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:01.588 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:01.583+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:01.624 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:01.620+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:01.836 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:01.833+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:01.929 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:01.923+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:02.091 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:02.087+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:02.092 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:02.089+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:02.341 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:02.336+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:02.407 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:02.404+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:02.583 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:02.576+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:02.620 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:02.616+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:02.832 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:02.829+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:02.895 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:02.889+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:03.108 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:03.105+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:03.109 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:03.106+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:03.365 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:03.361+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:03.372 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:03.370+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:03.609 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:03.604+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:03.612 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:03.608+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:03.824 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:03.820+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:03.941 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:03.935+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:04.084 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:04.080+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:04.084 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:04.081+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:04.398 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:04.394+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:04.400 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:04.397+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:04.616 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:04.612+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:04.636 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:04.631+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:04.833 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:04.830+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:04.967 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:04.961+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:05.107 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:05.092+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:05.110 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:05.100+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:05.373 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:05.368+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:05.418 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:05.415+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:05.603 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:05.598+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:05.658 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:05.653+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:05.788 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:05.786+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:06.020 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:06.015+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:06.119 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:06.116+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:06.121 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:06.119+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:06.388 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:06.383+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:06.414 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:06.409+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:06.656 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:06.651+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:06.670 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:06.666+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:06.777 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:06.774+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:07.036 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:07.029+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:07.085 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:07.080+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:07.086 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:07.083+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:07.396 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:07.390+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:07.397 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:07.394+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:07.643 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:07.638+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:07.692 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:07.688+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:07.796 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:07.791+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:07.995 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:07.989+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:08.077 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:08.072+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:08.077 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:08.074+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:08.370 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:08.365+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:08.442 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:08.439+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:08.615 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:08.609+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:08.708 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:08.704+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:08.805 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:08.802+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:09.008 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:09.002+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:09.059 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:09.054+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:09.060 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:09.056+0000 16949700 -1 osd.1 257 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:09.395 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:09.390+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:09.436 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:09.430+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:09.594 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:09.589+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:09.662 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:09.658+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:09.838 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:09.834+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:10.003 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:09.998+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:10.094 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:10.091+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:10.096 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:10.094+0000 16949700 -1 osd.1 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:10.373 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:10.368+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:10.403 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:10.399+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:10.644 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:10.640+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:10.646 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:08:10.642+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 47sec e257 v257) 2019-11-25T16:08:10.649 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:10.644+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:10.809 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:10.805+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:11.028 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:11.023+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:11.063 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:11.059+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:11.064 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:11.061+0000 16949700 -1 osd.1 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:11.336 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:11.331+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:11.409 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:11.405+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:11.672 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:11.668+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:11.694 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:11.690+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:11.779 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:11.776+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:12.019 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:12.015+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:12.020 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:12.017+0000 16949700 -1 osd.1 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:12.025 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:12.020+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:12.343 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:12.338+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:12.429 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:12.426+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:12.655 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:12.651+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:12.723 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:12.715+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:12.745 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:12.738+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:13.003 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:12.999+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:13.003 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:13.000+0000 16949700 -1 osd.1 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:13.078 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:13.073+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:13.394 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:13.388+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:13.458 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:13.454+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:13.702 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:13.698+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:13.708 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:13.704+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:13.710 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:13.705+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:14.030 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:14.026+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:14.032 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:14.030+0000 16949700 -1 osd.1 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:14.067 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:14.062+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:14.381 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:14.376+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:14.424 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:14.419+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:14.703 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:14.699+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:14.743 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:14.739+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:14.758 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:14.754+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:15.076 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:15.072+0000 16949700 -1 osd.1 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:52.980366+0000 front 2019-11-25T16:06:52.854794+0000 (oldest deadline 2019-11-25T16:07:37.219357+0000) 2019-11-25T16:08:15.079 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:15.077+0000 16949700 -1 osd.1 257 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:15.108 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:08:15.103+0000 16949700 -1 osd.4 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.046152+0000 front 2019-11-25T16:06:54.538405+0000 (oldest deadline 2019-11-25T16:07:39.927777+0000) 2019-11-25T16:08:15.352 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:08:15.347+0000 16949700 -1 osd.7 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.061249+0000 front 2019-11-25T16:06:55.205423+0000 (oldest deadline 2019-11-25T16:07:36.017487+0000) 2019-11-25T16:08:15.402 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:08:15.398+0000 16949700 -1 osd.2 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:49.779424+0000 front 2019-11-25T16:06:55.739979+0000 (oldest deadline 2019-11-25T16:07:35.531590+0000) 2019-11-25T16:08:15.722 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:08:15.719+0000 16949700 -1 osd.3 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:50.065108+0000 front 2019-11-25T16:06:49.825139+0000 (oldest deadline 2019-11-25T16:07:35.701197+0000) 2019-11-25T16:08:15.723 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:08:15.718+0000 16949700 -1 osd.0 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:55.128346+0000 front 2019-11-25T16:06:55.208377+0000 (oldest deadline 2019-11-25T16:07:38.886666+0000) 2019-11-25T16:08:15.734 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:08:15.725+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.5 [v2:172.21.15.174:6812/9175,v1:172.21.15.174:6814/9175] for 47sec e257 v257) 2019-11-25T16:08:15.740 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:08:15.736+0000 16949700 -1 osd.6 257 heartbeat_check: no reply from 172.21.15.174:6821 osd.5 since back 2019-11-25T16:06:56.059466+0000 front 2019-11-25T16:06:49.402973+0000 (oldest deadline 2019-11-25T16:07:34.640375+0000) 2019-11-25T16:08:16.528 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:16.278+0000 16949700 -1 osd.1 258 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:17.607 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:17.598+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:18.598 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:18.596+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:19.576 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:19.573+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:20.532 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:20.530+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:21.555 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:21.551+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:22.506 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:22.504+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:23.470 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:23.467+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:24.459 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:24.457+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:25.483 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:25.480+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:26.469 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:26.466+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:27.430 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:27.427+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:28.402 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:28.399+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:08:29.438 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:08:29.435+0000 16949700 -1 osd.1 259 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4509.0:113227 3.1a 3:5835bc1f:::.dir.b9020152-a9a6-4198-abf1-1fb1ecbb8573.4361.650:head [call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=160b] snapc 0=[] ondisk+write+known_if_redirected e257) 2019-11-25T16:09:11.203 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:11.199+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:12.258 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:12.254+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:12.342 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:12.336+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:13.023 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:13.018+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:13.256 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:13.252+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:13.303 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:13.298+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:13.821 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:13.817+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:14.001 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:13.996+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:14.216 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:14.212+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:14.223 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:14.218+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:14.279 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:14.274+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:14.859 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:14.855+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:15.021 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:15.015+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:15.173 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:15.169+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:15.238 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:15.233+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:15.258 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:15.254+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:15.301 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:15.292+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:15.862 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:15.858+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:16.069 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:16.063+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:16.154 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:16.150+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:16.204 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:16.200+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:16.274 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:16.266+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:16.334 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:16.328+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:16.872 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:16.868+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:17.055 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:17.048+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:17.108 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:17.106+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:17.209 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:17.206+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:17.287 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:17.284+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:17.379 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:17.374+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:17.827 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:17.823+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:18.092 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:18.087+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:18.141 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:18.137+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:18.208 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:18.204+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:18.295 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:18.293+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:18.414 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:18.409+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:18.828 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:18.824+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:19.121 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:19.116+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:19.127 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:19.123+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:19.222 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:19.217+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:19.286 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:19.282+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:19.462 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:19.457+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:19.848 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:19.845+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:20.134 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:20.130+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:20.159 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:20.153+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:20.180 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:20.176+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:20.305 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:20.302+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:20.309 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:20.304+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:20.458 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:20.453+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:20.884 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:20.880+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:21.096 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:21.093+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:21.148 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:21.143+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:21.181 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:21.178+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:21.326 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:21.321+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:21.345 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:21.342+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:21.475 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:21.469+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:21.893 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:21.889+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:22.109 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:22.104+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:22.116 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:22.111+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:22.140 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:22.137+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:22.346 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:22.343+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:22.369 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:22.365+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:22.490 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:22.486+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:22.944 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:22.940+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:23.078 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:23.073+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:23.149 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:23.145+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:23.169 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:23.164+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:23.327 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:23.322+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:23.404 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:23.400+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:23.531 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:23.527+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:23.981 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:23.976+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:24.064 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:24.059+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:24.108 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:24.104+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:24.215 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:24.211+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:24.371 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:24.366+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:24.419 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:24.415+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:24.531 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:24.526+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:24.985 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:24.980+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:25.119 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:25.111+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:25.126 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:25.121+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:25.177 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:25.172+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:25.384 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:25.379+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:25.465 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:25.462+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:25.518 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:25.511+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:25.950 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:25.945+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:26.088 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:26.084+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:26.132 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:26.127+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:26.197 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:26.192+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:26.370 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:26.365+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:26.458 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:26.453+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:26.459 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:26.455+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:26.554 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:26.550+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:26.999 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:26.994+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:27.069 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:27.066+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:27.176 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:27.171+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:27.210 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:27.206+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:27.373 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:27.368+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:27.499 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:27.495+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:27.503 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:27.499+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:27.597 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:27.592+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:27.953 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:27.950+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:28.042 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:28.038+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:28.219 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:28.216+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:28.235 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:28.231+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:28.327 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:28.324+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:28.533 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:28.528+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:28.534 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:28.530+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:28.595 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:28.590+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:28.942 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:28.938+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:29.004 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:28.998+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:29.211 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:29.206+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:29.213 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:29.209+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:29.285 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:29.281+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:29.511 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:29.507+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:29.514 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:29.511+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:29.649 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:29.645+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:29.961 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:29.957+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:29.973 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:29.968+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:30.175 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:30.172+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:30.244 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:30.240+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:30.271 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:30.267+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:30.508 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:30.504+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:30.512 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:30.508+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:30.694 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:30.689+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:30.929 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:30.925+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:30.953 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:30.949+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:31.225 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:31.221+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:31.275 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:31.269+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:31.279 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:31.274+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:31.520 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:31.514+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:31.521 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:31.516+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:31.708 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:31.703+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:31.917 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:31.913+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:31.957 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:31.952+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:32.242 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:32.238+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:32.247 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:32.244+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:32.310 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:32.307+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:32.558 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:32.554+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:32.561 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:32.557+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:32.727 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:32.723+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:32.873 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:32.869+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:33.005 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:33.001+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:33.240 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:33.237+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:33.247 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:33.243+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:33.320 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:33.316+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:33.568 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:33.564+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:33.571 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:33.568+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:33.698 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:33.694+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:33.912 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:33.908+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:34.004 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:34.000+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:34.215 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:34.209+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:34.252 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:34.248+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:34.286 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:34.283+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:34.625 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:34.610+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:34.625 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:34.614+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:34.746 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:34.742+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:34.929 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:34.926+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:34.979 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:34.975+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:35.226 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:35.222+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:35.260 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:35.256+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:35.299 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:35.296+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:35.662 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:35.659+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:35.665 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:35.662+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:35.763 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:35.759+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:35.902 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:35.898+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:35.961 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:35.957+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:36.244 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:36.239+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:36.245 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:36.241+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:36.352 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:36.349+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:36.707 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:36.703+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:36.709 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:36.706+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:36.782 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:36.778+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:36.898 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:36.894+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:36.956 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:36.951+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:37.272 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:37.261+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:37.282 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:37.279+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:37.374 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:37.370+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:37.681 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:37.676+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:37.682 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:37.678+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:37.833 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:37.828+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:37.899 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:37.895+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:37.966 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:37.962+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:38.293 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:38.290+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:38.324 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:38.320+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:38.379 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:38.376+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:38.664 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:38.661+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:38.666 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:38.663+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:38.825 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:38.820+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:38.923 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:38.920+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:39.000 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:38.996+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:39.326 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:39.321+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:39.373 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:39.364+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:39.392 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:39.388+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:39.653 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:39.648+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:39.656 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:39.652+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:39.858 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:39.852+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:39.972 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:39.967+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:40.050 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:40.045+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:40.302 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:40.298+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:40.327 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:40.324+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:40.356 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:40.354+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:40.669 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:40.664+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:40.673 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:40.668+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:40.849 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:40.844+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:40.981 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:40.977+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:41.071 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:41.066+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:41.334 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:41.331+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:41.353 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:41.349+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:41.390 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:41.387+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:41.658 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:41.652+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:41.659 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:41.654+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:41.891 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:41.885+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:42.006 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:42.002+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:42.093 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:42.088+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:42.308 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:42.304+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:42.340 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:42.337+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:42.364 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:42.355+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:42.701 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:42.697+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:42.704 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:42.700+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:42.852 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:42.846+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:43.058 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:43.053+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:43.061 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:43.057+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:43.316 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:43.312+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:43.341 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:43.338+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:43.395 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:43.389+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:43.686 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:43.680+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:43.687 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:43.682+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:43.895 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:43.888+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:44.035 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:44.030+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:44.093 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:44.089+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:44.313 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:44.309+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:44.361 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:44.357+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:44.369 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:44.366+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:44.669 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:44.662+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:44.669 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:44.664+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:44.910 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:44.905+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:45.021 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:45.017+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:45.113 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:45.108+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:45.334 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:45.329+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:45.338 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:45.334+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:45.385 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:45.380+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:45.633 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:45.629+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:45.636 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:45.632+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:45.862 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:45.858+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:45.985 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:45.980+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:45.992 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:09:45.988+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 43sec e263 v263) 2019-11-25T16:09:46.088 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:46.085+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:46.322 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:46.318+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:46.346 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:46.343+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:46.390 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:46.386+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:46.609 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:46.603+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:46.610 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:46.605+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:46.870 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:46.861+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:47.031 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:47.026+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:47.092 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:47.085+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:47.307 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:47.304+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:47.312 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:47.309+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:47.377 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:47.373+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:47.581 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:47.575+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:47.581 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:47.576+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:47.823 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:47.817+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:48.079 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:48.074+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:48.099 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:48.096+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:48.295 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:48.292+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:48.348 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:48.345+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:48.380 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:48.377+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:48.627 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:48.622+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:48.628 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:48.623+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:48.864 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:48.860+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:49.070 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:49.064+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:49.093 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:49.089+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:49.311 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:49.307+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:49.343 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:49.338+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:49.349 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:49.345+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:49.662 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:49.656+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:49.663 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:49.658+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:49.913 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:49.908+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:50.045 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:50.039+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:50.088 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:50.081+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:50.331 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:50.327+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:50.360 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:50.357+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:50.380 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:50.377+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:50.688 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:50.681+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:50.688 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:50.684+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:50.952 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:50.944+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:51.008 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:09:51.005+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 43sec e263 v263) 2019-11-25T16:09:51.038 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:51.035+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:51.056 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:51.051+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:51.314 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:51.310+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:51.364 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:51.360+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:51.402 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:51.398+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:51.647 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:51.642+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:51.650 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:51.645+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:51.937 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:51.931+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:52.039 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:52.034+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:52.051 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:52.047+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:52.324 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:52.313+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:52.400 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:52.397+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:52.442 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:52.439+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:52.606 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:52.600+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:52.607 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:52.602+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:52.990 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:52.984+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:53.027 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:53.021+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:53.066 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:53.062+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:53.343 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:53.340+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:53.400 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:53.397+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:53.450 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:53.447+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:53.629 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:53.624+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:53.630 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:53.625+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:54.012 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:54.006+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:54.053 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:54.049+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:54.063 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:54.058+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:54.376 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:54.371+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:54.393 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:54.389+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:54.495 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:54.492+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:54.632 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:54.626+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:54.632 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:54.629+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:55.030 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:55.025+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:55.060 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:55.056+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:55.066 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:55.060+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:55.336 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:55.329+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:55.359 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:55.356+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:55.477 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:55.474+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:55.607 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:55.602+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:55.610 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:55.606+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:55.997 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:55.993+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:56.025 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:56.021+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:56.029 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:09:56.024+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 43sec e263 v263) 2019-11-25T16:09:56.091 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:56.086+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:56.329 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:56.326+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:56.355 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:56.350+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:56.452 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:56.448+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:56.586 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:56.580+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:56.587 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:56.581+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:56.994 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:56.989+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:57.078 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:57.074+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:57.108 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:57.103+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:57.350 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:57.344+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:57.351 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:57.345+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:57.501 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:57.497+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:57.624 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:57.616+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:57.625 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:57.618+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:57.949 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:57.944+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:58.093 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:58.086+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:58.124 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:58.120+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:58.341 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:58.336+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:58.358 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:58.355+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:58.478 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:58.475+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:58.646 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:58.642+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:58.648 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:58.645+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:09:59.001 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:09:58.996+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:09:59.066 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:09:59.060+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:09:59.133 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:09:59.129+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:09:59.364 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:09:59.360+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:09:59.391 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:09:59.386+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:09:59.460 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:09:59.457+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:09:59.625 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:59.620+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:09:59.628 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:09:59.624+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:10:00.054 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:10:00.049+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:10:00.079 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:10:00.073+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:10:00.122 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:10:00.118+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:10:00.327 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:10:00.323+0000 16949700 -1 osd.2 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:28.979890+0000 front 2019-11-25T16:08:29.018534+0000 (oldest deadline 2019-11-25T16:09:13.987322+0000) 2019-11-25T16:10:00.420 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:10:00.418+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:10:00.469 INFO:tasks.ceph.osd.3.smithi135.stderr:2019-11-25T16:10:00.467+0000 16949700 -1 osd.3 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:33.179623+0000 front 2019-11-25T16:08:29.681500+0000 (oldest deadline 2019-11-25T16:09:14.898481+0000) 2019-11-25T16:10:00.647 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:10:00.640+0000 16949700 -1 osd.5 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 ever on either front or back, first ping sent 2019-11-25T16:08:46.371739+0000 (oldest deadline 2019-11-25T16:09:26.371739+0000) 2019-11-25T16:10:00.647 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:10:00.643+0000 16949700 -1 osd.5 263 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:10:01.042 INFO:tasks.ceph.osd.6.smithi174.stderr:2019-11-25T16:10:01.037+0000 16949700 -1 osd.6 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:32.921970+0000 front 2019-11-25T16:08:27.674963+0000 (oldest deadline 2019-11-25T16:09:12.826267+0000) 2019-11-25T16:10:01.093 INFO:tasks.ceph.osd.7.smithi174.stderr:2019-11-25T16:10:01.087+0000 16949700 -1 osd.7 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.497247+0000 front 2019-11-25T16:08:30.258541+0000 (oldest deadline 2019-11-25T16:09:12.256179+0000) 2019-11-25T16:10:01.097 INFO:tasks.ceph.mon.a.smithi135.stderr:2019-11-25T16:10:01.095+0000 1a898700 -1 mon.a@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.4 [v2:172.21.15.174:6810/9176,v1:172.21.15.174:6811/9176] for 43sec e263 v263) 2019-11-25T16:10:01.108 INFO:tasks.ceph.osd.1.smithi135.stderr:2019-11-25T16:10:01.105+0000 16949700 -1 osd.1 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:30.219855+0000 front 2019-11-25T16:08:27.487848+0000 (oldest deadline 2019-11-25T16:09:13.055986+0000) 2019-11-25T16:10:01.396 INFO:tasks.ceph.osd.0.smithi135.stderr:2019-11-25T16:10:01.393+0000 16949700 -1 osd.0 263 heartbeat_check: no reply from 172.21.15.174:6816 osd.4 since back 2019-11-25T16:08:31.092753+0000 front 2019-11-25T16:08:30.178310+0000 (oldest deadline 2019-11-25T16:09:10.526259+0000) 2019-11-25T16:10:01.889 INFO:tasks.ceph.osd.5.smithi174.stderr:2019-11-25T16:10:01.731+0000 16949700 -1 osd.5 264 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4361.0:90881 7.9 7.31bb659 (undecoded) ondisk+retry+read+known_if_redirected e261) 2019-11-25T16:10:31.842 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:10:31.836+0000 16949700 -1 osd.2 265 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113547 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821484416 gen 85] snapc 0=[] ondisk+write+known_if_redirected e264) 2019-11-25T16:10:32.892 INFO:tasks.ceph.osd.2.smithi135.stderr:2019-11-25T16:10:32.871+0000 16949700 -1 osd.2 265 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4509.0:113547 5.0 5:05bf5b68:::notify.1:head [watch reconnect cookie 821484416 gen 85] snapc 0=[] ondisk+write+known_if_redirected e264) 2019-11-25T16:10:33.677 INFO:tasks.ceph.osd.4.smithi174.stderr:*** Caught signal (Segmentation fault) ** 2019-11-25T16:10:33.677 INFO:tasks.ceph.osd.4.smithi174.stderr: in thread 11ca9700 thread_name:msgr-worker-1 2019-11-25T16:10:33.731 INFO:tasks.ceph.osd.4.smithi174.stderr: ceph version 15.0.0-7614-g12b9659 (12b9659be24ae0e3d791f80d81504ab2770c1343) octopus (dev) 2019-11-25T16:10:33.731 INFO:tasks.ceph.osd.4.smithi174.stderr: 1: (()+0xf5f0) [0xc0985f0] 2019-11-25T16:10:33.731 INFO:tasks.ceph.osd.4.smithi174.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe87781] 2019-11-25T16:10:33.731 INFO:tasks.ceph.osd.4.smithi174.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x1008dd0] 2019-11-25T16:10:33.731 INFO:tasks.ceph.osd.4.smithi174.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1015b73] 2019-11-25T16:10:33.732 INFO:tasks.ceph.osd.4.smithi174.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1015df0] 2019-11-25T16:10:33.732 INFO:tasks.ceph.osd.4.smithi174.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101634d] 2019-11-25T16:10:33.732 INFO:tasks.ceph.osd.4.smithi174.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0xffefd4] 2019-11-25T16:10:33.732 INFO:tasks.ceph.osd.4.smithi174.stderr: 8: (AsyncConnection::process()+0x794) [0xfd9624] 2019-11-25T16:10:33.732 INFO:tasks.ceph.osd.4.smithi174.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3ab05] 2019-11-25T16:10:33.732 INFO:tasks.ceph.osd.4.smithi174.stderr: 10: (()+0xd38517) [0xe40517] 2019-11-25T16:10:33.732 INFO:tasks.ceph.osd.4.smithi174.stderr: 11: (()+0x121040f) [0x131840f] 2019-11-25T16:10:33.733 INFO:tasks.ceph.osd.4.smithi174.stderr: 12: (()+0x7e65) [0xc090e65] 2019-11-25T16:10:33.733 INFO:tasks.ceph.osd.4.smithi174.stderr: 13: (clone()+0x6d) [0xd20888d] 2019-11-25T16:10:33.770 INFO:tasks.ceph.osd.4.smithi174.stderr:2019-11-25T16:10:33.763+0000 11ca9700 -1 *** Caught signal (Segmentation fault) ** 2019-11-25T16:10:33.771 INFO:tasks.ceph.osd.4.smithi174.stderr: in thread 11ca9700 thread_name:msgr-worker-1 2019-11-25T16:10:33.771 INFO:tasks.ceph.osd.4.smithi174.stderr: 2019-11-25T16:10:33.771 INFO:tasks.ceph.osd.4.smithi174.stderr: ceph version 15.0.0-7614-g12b9659 (12b9659be24ae0e3d791f80d81504ab2770c1343) octopus (dev) 2019-11-25T16:10:33.771 INFO:tasks.ceph.osd.4.smithi174.stderr: 1: (()+0xf5f0) [0xc0985f0] 2019-11-25T16:10:33.771 INFO:tasks.ceph.osd.4.smithi174.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe87781] 2019-11-25T16:10:33.771 INFO:tasks.ceph.osd.4.smithi174.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x1008dd0] 2019-11-25T16:10:33.772 INFO:tasks.ceph.osd.4.smithi174.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1015b73] 2019-11-25T16:10:33.772 INFO:tasks.ceph.osd.4.smithi174.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1015df0] 2019-11-25T16:10:33.772 INFO:tasks.ceph.osd.4.smithi174.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101634d] 2019-11-25T16:10:33.772 INFO:tasks.ceph.osd.4.smithi174.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0xffefd4] 2019-11-25T16:10:33.772 INFO:tasks.ceph.osd.4.smithi174.stderr: 8: (AsyncConnection::process()+0x794) [0xfd9624] 2019-11-25T16:10:33.772 INFO:tasks.ceph.osd.4.smithi174.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3ab05] 2019-11-25T16:10:33.772 INFO:tasks.ceph.osd.4.smithi174.stderr: 10: (()+0xd38517) [0xe40517] 2019-11-25T16:10:33.772 INFO:tasks.ceph.osd.4.smithi174.stderr: 11: (()+0x121040f) [0x131840f] 2019-11-25T16:10:33.773 INFO:tasks.ceph.osd.4.smithi174.stderr: 12: (()+0x7e65) [0xc090e65] 2019-11-25T16:10:33.773 INFO:tasks.ceph.osd.4.smithi174.stderr: 13: (clone()+0x6d) [0xd20888d] 2019-11-25T16:10:33.773 INFO:tasks.ceph.osd.4.smithi174.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-25T16:10:33.773 INFO:tasks.ceph.osd.4.smithi174.stderr: 2019-11-25T16:10:34.297 INFO:tasks.ceph.osd.4.smithi174.stderr: -3> 2019-11-25T16:10:33.763+0000 11ca9700 -1 *** Caught signal (Segmentation fault) ** 2019-11-25T16:10:34.297 INFO:tasks.ceph.osd.4.smithi174.stderr: in thread 11ca9700 thread_name:msgr-worker-1 2019-11-25T16:10:34.297 INFO:tasks.ceph.osd.4.smithi174.stderr: 2019-11-25T16:10:34.297 INFO:tasks.ceph.osd.4.smithi174.stderr: ceph version 15.0.0-7614-g12b9659 (12b9659be24ae0e3d791f80d81504ab2770c1343) octopus (dev) 2019-11-25T16:10:34.297 INFO:tasks.ceph.osd.4.smithi174.stderr: 1: (()+0xf5f0) [0xc0985f0] 2019-11-25T16:10:34.298 INFO:tasks.ceph.osd.4.smithi174.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe87781] 2019-11-25T16:10:34.298 INFO:tasks.ceph.osd.4.smithi174.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x1008dd0] 2019-11-25T16:10:34.298 INFO:tasks.ceph.osd.4.smithi174.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1015b73] 2019-11-25T16:10:34.298 INFO:tasks.ceph.osd.4.smithi174.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1015df0] 2019-11-25T16:10:34.298 INFO:tasks.ceph.osd.4.smithi174.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101634d] 2019-11-25T16:10:34.298 INFO:tasks.ceph.osd.4.smithi174.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0xffefd4] 2019-11-25T16:10:34.298 INFO:tasks.ceph.osd.4.smithi174.stderr: 8: (AsyncConnection::process()+0x794) [0xfd9624] 2019-11-25T16:10:34.298 INFO:tasks.ceph.osd.4.smithi174.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3ab05] 2019-11-25T16:10:34.299 INFO:tasks.ceph.osd.4.smithi174.stderr: 10: (()+0xd38517) [0xe40517] 2019-11-25T16:10:34.299 INFO:tasks.ceph.osd.4.smithi174.stderr: 11: (()+0x121040f) [0x131840f] 2019-11-25T16:10:34.299 INFO:tasks.ceph.osd.4.smithi174.stderr: 12: (()+0x7e65) [0xc090e65] 2019-11-25T16:10:34.299 INFO:tasks.ceph.osd.4.smithi174.stderr: 13: (clone()+0x6d) [0xd20888d] 2019-11-25T16:10:34.299 INFO:tasks.ceph.osd.4.smithi174.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-25T16:10:34.299 INFO:tasks.ceph.osd.4.smithi174.stderr: 2019-11-25T16:10:34.654 INFO:tasks.ceph.osd.4.smithi174.stderr: -1004> 2019-11-25T16:10:33.763+0000 11ca9700 -1 *** Caught signal (Segmentation fault) ** 2019-11-25T16:10:34.654 INFO:tasks.ceph.osd.4.smithi174.stderr: in thread 11ca9700 thread_name:msgr-worker-1 2019-11-25T16:10:34.654 INFO:tasks.ceph.osd.4.smithi174.stderr: 2019-11-25T16:10:34.655 INFO:tasks.ceph.osd.4.smithi174.stderr: ceph version 15.0.0-7614-g12b9659 (12b9659be24ae0e3d791f80d81504ab2770c1343) octopus (dev) 2019-11-25T16:10:34.655 INFO:tasks.ceph.osd.4.smithi174.stderr: 1: (()+0xf5f0) [0xc0985f0] 2019-11-25T16:10:34.655 INFO:tasks.ceph.osd.4.smithi174.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe87781] 2019-11-25T16:10:34.655 INFO:tasks.ceph.osd.4.smithi174.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x1008dd0] 2019-11-25T16:10:34.655 INFO:tasks.ceph.osd.4.smithi174.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1015b73] 2019-11-25T16:10:34.656 INFO:tasks.ceph.osd.4.smithi174.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x1015df0] 2019-11-25T16:10:34.656 INFO:tasks.ceph.osd.4.smithi174.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101634d] 2019-11-25T16:10:34.656 INFO:tasks.ceph.osd.4.smithi174.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0xffefd4] 2019-11-25T16:10:34.656 INFO:tasks.ceph.osd.4.smithi174.stderr: 8: (AsyncConnection::process()+0x794) [0xfd9624] 2019-11-25T16:10:34.657 INFO:tasks.ceph.osd.4.smithi174.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3ab05] 2019-11-25T16:10:34.657 INFO:tasks.ceph.osd.4.smithi174.stderr: 10: (()+0xd38517) [0xe40517] 2019-11-25T16:10:34.657 INFO:tasks.ceph.osd.4.smithi174.stderr: 11: (()+0x121040f) [0x131840f] 2019-11-25T16:10:34.657 INFO:tasks.ceph.osd.4.smithi174.stderr: 12: (()+0x7e65) [0xc090e65] 2019-11-25T16:10:34.657 INFO:tasks.ceph.osd.4.smithi174.stderr: 13: (clone()+0x6d) [0xd20888d] 2019-11-25T16:10:34.658 INFO:tasks.ceph.osd.4.smithi174.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-11-25T16:10:34.658 INFO:tasks.ceph.osd.4.smithi174.stderr: 2019-11-25T16:10:37.552 INFO:tasks.ceph.osd.4.smithi174.stderr:daemon-helper: command crashed with signal 11 2019-11-25T16:10:42.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2019-11-25T16:10:48.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~6s 2019-11-25T16:10:55.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~13s 2019-11-25T16:11:01.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~19s 2019-11-25T16:11:07.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~25s 2019-11-25T16:11:13.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~32s 2019-11-25T16:11:20.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~38s 2019-11-25T16:11:26.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~44s 2019-11-25T16:11:30.507 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:46:43.654 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:11:30.515 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:46:43.662 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:11:30.530 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:46:43.677 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:11:30.535 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:46:43.682 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:11:30.536 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:46:43.787 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:11:30.541 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:46:43.791 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:11:30.807 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:46:43.954 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:11:30.810 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:46:43.957 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:11:30.811 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:46:44.061 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:11:32.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~51s 2019-11-25T16:11:39.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~57s 2019-11-25T16:11:45.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~63s 2019-11-25T16:11:51.874 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~69s 2019-11-25T16:11:58.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~76s 2019-11-25T16:12:04.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~82s 2019-11-25T16:12:10.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~88s 2019-11-25T16:12:17.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~95s 2019-11-25T16:12:23.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~101s 2019-11-25T16:12:29.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~107s 2019-11-25T16:12:36.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~114s 2019-11-25T16:12:42.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~120s 2019-11-25T16:12:48.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~126s 2019-11-25T16:12:54.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~133s 2019-11-25T16:13:01.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~139s 2019-11-25T16:13:07.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~145s 2019-11-25T16:13:13.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~151s 2019-11-25T16:13:20.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~158s 2019-11-25T16:13:26.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~164s 2019-11-25T16:13:32.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~170s 2019-11-25T16:13:39.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~177s 2019-11-25T16:13:45.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~183s 2019-11-25T16:13:51.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~189s 2019-11-25T16:13:58.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~196s 2019-11-25T16:14:04.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~202s 2019-11-25T16:14:10.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~208s 2019-11-25T16:14:17.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~215s 2019-11-25T16:14:23.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~221s 2019-11-25T16:14:29.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~227s 2019-11-25T16:14:35.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~234s 2019-11-25T16:14:42.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~240s 2019-11-25T16:14:48.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~246s 2019-11-25T16:14:54.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~252s 2019-11-25T16:15:01.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~259s 2019-11-25T16:15:07.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~265s 2019-11-25T16:15:13.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~271s 2019-11-25T16:15:20.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~278s 2019-11-25T16:15:26.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~284s 2019-11-25T16:15:32.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~290s 2019-11-25T16:15:37.460 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:50:50.605 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:15:37.481 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:50:50.627 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:15:37.535 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:50:50.682 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:15:37.540 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:50:50.686 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:15:37.557 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:50:50.807 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:15:37.559 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:50:50.810 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:15:37.670 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:50:50.816 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:15:37.733 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:50:50.983 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:15:37.779 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:50:50.926 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:15:39.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~297s 2019-11-25T16:15:45.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~303s 2019-11-25T16:15:45.374 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-11-25T16:15:45.374 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-add-kafka-security2/qa/tasks/daemonwatchdog.py", line 38, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-add-kafka-security2/qa/tasks/daemonwatchdog.py", line 114, in watch self.bark() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-yuval-add-kafka-security2/qa/tasks/daemonwatchdog.py", line 54, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-11-25T16:16:07.834 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:51:20.981 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:07.878 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:51:21.024 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:07.931 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:51:21.078 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:07.948 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:51:21.198 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:07.956 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:51:21.206 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:07.973 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:51:21.120 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:07.975 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:51:21.121 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:08.059 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:51:21.205 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:08.099 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:51:21.349 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:35.825 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:51:48.971 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:35.831 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:51:48.978 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:35.843 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:51:48.990 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:35.846 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:51:49.096 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:35.847 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:51:48.994 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:35.860 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:51:49.110 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:35.879 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:51:49.025 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:35.909 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:51:49.056 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:16:35.978 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:51:49.228 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:21:06.143 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:56:19.290 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:21:06.151 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:56:19.297 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:21:06.162 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:56:19.309 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:21:06.163 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:56:19.414 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:21:06.165 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:56:19.312 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:21:06.172 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:56:19.422 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:21:06.421 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:56:19.671 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:21:06.478 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:56:19.625 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:21:06.507 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:56:19.653 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:23:59.522 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:59:12.668 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:23:59.560 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:59:12.706 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:23:59.598 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:59:12.744 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:23:59.600 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:59:12.850 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:23:59.604 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:59:12.854 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:23:59.605 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:59:12.751 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:23:59.844 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:59:12.991 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:23:59.869 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:59:13.015 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:23:59.923 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:59:13.173 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:24:24.403 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:59:37.549 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:24:24.410 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:59:37.556 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:24:24.412 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:59:37.558 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:24:24.416 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:59:37.563 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:24:24.428 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:59:37.678 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:24:24.458 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:59:37.708 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:24:24.483 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:06:59:37.629 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:24:24.483 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:06:59:37.629 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:24:24.522 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:06:59:37.772 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:29:35.910 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:04:49.056 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:29:35.921 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:04:49.068 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:29:35.931 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:04:49.077 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:29:35.934 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:04:49.184 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:29:35.935 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:04:49.082 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:29:35.943 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:04:49.193 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:29:36.117 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:04:49.263 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:29:36.117 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:04:49.264 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:29:36.213 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:04:49.463 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:32:21.432 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:07:34.579 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:32:21.449 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:07:34.595 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:32:21.507 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:07:34.653 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:32:21.511 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:07:34.657 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:32:21.516 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:07:34.767 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:32:21.520 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:07:34.771 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:32:21.549 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:07:34.695 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:32:21.595 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:07:34.741 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:32:21.651 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:07:34.901 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:34:47.008 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:10:00.154 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:34:47.020 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:10:00.166 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:34:47.041 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:10:00.187 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:34:47.051 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:10:00.295 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:34:47.051 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:10:00.191 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:34:47.061 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:10:00.311 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:34:47.141 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:10:00.288 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:34:47.148 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:10:00.294 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:34:47.201 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:10:00.451 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:39:59.227 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:15:12.373 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:39:59.237 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:15:12.383 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:39:59.255 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:15:12.401 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:39:59.259 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:15:12.509 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:39:59.259 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:15:12.405 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:39:59.265 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:15:12.515 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:39:59.410 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:15:12.556 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:39:59.481 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:15:12.731 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:39:59.567 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:15:12.712 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:40:43.206 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:15:56.352 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:40:43.210 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:15:56.356 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:40:43.249 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:15:56.394 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:40:43.271 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:15:56.417 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:40:43.281 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:15:56.530 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:40:43.281 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:15:56.427 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:40:43.283 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:15:56.533 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:40:43.331 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:15:56.477 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:40:43.345 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:15:56.595 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:44:44.012 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:19:57.158 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:44:44.018 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:19:57.164 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:44:44.131 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:19:57.277 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:44:44.133 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:19:57.383 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:44:44.138 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:19:57.388 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:44:44.139 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:19:57.285 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:44:44.251 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:19:57.397 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:44:44.279 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:19:57.425 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:44:44.317 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:19:57.567 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:45:10.302 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:20:23.448 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:45:10.308 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:20:23.455 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:45:10.322 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:20:23.468 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:45:10.329 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:20:23.579 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:45:10.331 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:20:23.477 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:45:10.335 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:20:23.586 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:45:10.353 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:20:23.499 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:45:10.371 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:20:23.517 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:45:10.422 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:20:23.673 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:49:04.989 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:24:18.135 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:49:05.021 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:24:18.167 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:49:05.039 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:24:18.185 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:49:05.040 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:24:18.186 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:49:05.071 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:24:18.321 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:49:05.074 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:24:18.324 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:49:05.136 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:24:18.282 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:49:05.148 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:24:18.295 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:49:05.246 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:24:18.496 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:50:19.828 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:25:32.974 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:50:19.834 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:25:32.980 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:50:19.857 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:25:33.107 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:50:19.863 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:25:33.009 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:50:19.869 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:25:33.015 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:50:19.871 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:25:33.122 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:50:19.911 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:25:33.057 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:50:19.934 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:25:33.080 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:50:19.990 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:25:33.240 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:55:32.490 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:30:45.636 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:55:32.499 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:30:45.645 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:55:32.510 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:30:45.656 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:55:32.513 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:30:45.659 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:55:32.531 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:30:45.782 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:55:32.544 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:30:45.794 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:55:32.690 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:30:45.836 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:55:32.697 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:30:45.843 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:55:32.793 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:30:46.044 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:57:26.814 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:32:39.960 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:57:26.817 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:32:39.963 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:57:26.837 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:32:39.983 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:57:26.864 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:32:40.010 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:57:26.894 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:32:40.145 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:57:26.900 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:32:40.151 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T16:57:26.909 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:32:40.055 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T16:57:26.932 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:32:40.078 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T16:57:27.083 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:32:40.333 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:00:42.611 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:35:55.757 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:00:42.619 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:35:55.765 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:00:42.633 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:35:55.779 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:00:42.640 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:35:55.891 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:00:42.641 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:35:55.787 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:00:42.646 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:35:55.896 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:00:42.762 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:35:55.908 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:00:42.765 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:35:55.911 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:00:42.806 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:35:56.057 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:48.468 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:41:01.613 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:48.470 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:41:01.616 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:48.526 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:41:01.671 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:48.529 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:41:01.675 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:48.554 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:41:01.804 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:48.557 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:41:01.807 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:48.681 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:41:01.826 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:48.744 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:41:01.890 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:48.798 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:41:02.048 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:53.886 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:41:07.032 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:53.892 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:41:07.038 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:53.914 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:41:07.060 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:53.915 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:41:07.166 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:53.921 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:41:07.172 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:53.925 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:41:07.071 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:53.944 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:41:07.090 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:53.974 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:41:07.120 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:05:54.028 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:41:07.279 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:11:09.227 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:46:22.373 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:11:09.229 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:46:22.375 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:11:09.303 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:46:22.449 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:11:09.304 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:46:22.554 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:11:09.309 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:46:22.560 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:11:09.323 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:46:22.469 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:11:09.465 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:46:22.611 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:11:09.534 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:46:22.680 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:11:09.536 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:46:22.787 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:14:15.613 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:49:28.758 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:14:15.624 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:49:28.768 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:14:15.657 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:49:28.907 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:14:15.659 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:49:28.909 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:14:15.684 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:49:28.827 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:14:15.702 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:49:28.847 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:14:15.726 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:49:28.872 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:14:15.770 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:49:29.020 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:14:15.793 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:49:28.938 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:16:21.029 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:51:34.175 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:16:21.035 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:51:34.181 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:16:21.042 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:51:34.188 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:16:21.047 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:51:34.193 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:16:21.060 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:51:34.311 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:16:21.069 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:51:34.320 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:16:21.119 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:51:34.264 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:16:21.137 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:51:34.283 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:16:21.189 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:51:34.440 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:21:33.061 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:56:46.207 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:21:33.074 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:56:46.220 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:21:33.076 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:56:46.222 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:21:33.081 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:56:46.227 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:21:33.089 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:56:46.340 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:21:33.110 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:56:46.361 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:21:33.255 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:56:46.401 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:21:33.380 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:56:46.526 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:21:33.499 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:56:46.750 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:22:37.224 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:57:50.370 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:22:37.277 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:57:50.422 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:22:37.287 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:57:50.433 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:22:37.289 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:57:50.435 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:22:37.309 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:57:50.560 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:22:37.313 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:57:50.564 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:22:37.336 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:07:57:50.482 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:22:37.337 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:07:57:50.483 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:22:37.396 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:07:57:50.647 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:25:38.272 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:08:00:51.418 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:25:38.288 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:08:00:51.433 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:25:38.343 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:08:00:51.489 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:25:38.357 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:08:00:51.503 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:25:38.382 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:08:00:51.632 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:25:38.390 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:08:00:51.641 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:25:38.479 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:08:00:51.624 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:25:38.479 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:08:00:51.625 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:25:38.538 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:08:00:51.789 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:26:43.408 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:08:01:56.553 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:26:43.418 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:08:01:56.563 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:26:43.428 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:08:01:56.574 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:26:43.433 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:08:01:56.578 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:26:43.437 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:08:01:56.688 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:26:43.448 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:08:01:56.699 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:26:43.494 INFO:tasks.ceph.mon.c.smithi135.stderr:==00:08:01:56.640 8999== Warning: unimplemented fcntl command: 1036 2019-11-25T17:26:43.515 INFO:tasks.ceph.mon.a.smithi135.stderr:==00:08:01:56.661 8995== Warning: unimplemented fcntl command: 1036 2019-11-25T17:26:43.561 INFO:tasks.ceph.mon.b.smithi174.stderr:==00:08:01:56.812 8259== Warning: unimplemented fcntl command: 1036 2019-11-25T17:30:07.140 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-11-25T17:30:07.140 DEBUG:teuthology.task.console_log:Killing console logger for smithi174 2019-11-25T17:30:07.141 DEBUG:teuthology.task.console_log:Killing console logger for smithi135 2019-11-25T17:30:07.141 DEBUG:teuthology.task.console_log:Killing console logger for smithi174 2019-11-25T17:30:07.141 DEBUG:teuthology.task.console_log:Killing console logger for smithi135 2019-11-25T17:30:07.141 DEBUG:teuthology.exit:Finished running handlers